-- Logs begin at Thu 2022-06-16 20:03:24 UTC, end at Thu 2022-06-16 21:33:19 UTC. -- Jun 16 21:04:10.286448 dv-cinder-819149-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 21:04:10.295172 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 21:04:10.297104 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 21:04:10 2022] *** Jun 16 21:04:10.297104 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 21:04:10.297104 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 21:04:10.297104 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: nodename: dv-cinder-819149-6-iscsi Jun 16 21:04:10.297104 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: machine: x86_64 Jun 16 21:04:10.297104 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: clock source: unix Jun 16 21:04:10.297104 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: pcre jit disabled Jun 16 21:04:10.297104 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: detected number of CPU cores: 4 Jun 16 21:04:10.297104 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: current working directory: / Jun 16 21:04:10.297104 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: detected binary path: /usr/bin/uwsgi-core Jun 16 21:04:10.297815 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: your processes number limit is 47680 Jun 16 21:04:10.297815 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: your memory page size is 4096 bytes Jun 16 21:04:10.297815 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: detected max file descriptor number: 2048 Jun 16 21:04:10.297815 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: lock engine: pthread robust mutexes Jun 16 21:04:10.297815 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: thunder lock: enabled Jun 16 21:04:10.297815 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 21:04:10.297815 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 21:04:10.341082 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: Python main interpreter initialized at 0x56281a5599c0 Jun 16 21:04:10.341082 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: python threads support enabled Jun 16 21:04:10.341082 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: your server socket listen backlog is limited to 100 connections Jun 16 21:04:10.341082 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: your mercy for graceful operations on workers is 90 seconds Jun 16 21:04:10.341412 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 21:04:10.341547 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: *** Operational MODE: preforking *** Jun 16 21:04:10.341855 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: *** uWSGI is running in multiple interpreter mode *** Jun 16 21:04:10.341855 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: spawned uWSGI master process (pid: 103367) Jun 16 21:04:10.342041 dv-cinder-819149-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 21:04:10.343576 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: spawned uWSGI worker 1 (pid: 103368, cores: 1) Jun 16 21:04:10.343576 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: spawned uWSGI worker 2 (pid: 103369, cores: 1) Jun 16 21:04:10.343576 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 21:04:11.009324 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 21:04:11.014733 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 21:04:12.192592 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 21:04:12.192592 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: from cryptography.utils import int_from_bytes Jun 16 21:04:12.193219 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 21:04:12.193219 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: from cryptography.utils import int_from_bytes Jun 16 21:04:12.193339 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 21:04:12.193339 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: from cryptography.utils import int_from_bytes Jun 16 21:04:12.193714 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 21:04:12.193714 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: from cryptography.utils import int_from_bytes Jun 16 21:04:14.744985 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 21:04:14.745565 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 21:04:14.745746 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 21:04:14.746110 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 21:04:14.746371 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 21:04:14.746756 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.747084 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.747414 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.747775 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.748618 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.748932 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.749255 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.749575 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.749903 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.750169 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.750486 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.750623 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 21:04:14.751015 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-6-iscsi {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.751107 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 21:04:14.751190 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.751396 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 21:04:14.751492 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.751713 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.751816 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 21:04:14.752010 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 21:04:14.752144 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.752347 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.752489 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.752669 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.752820 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.752976 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.753145 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.753469 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.753567 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.753804 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.753900 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.754114 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.754202 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.754440 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.754549 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.754762 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.754857 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.755091 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.755187 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.755361 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.755469 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.755677 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.755763 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.756003 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-6-iscsi {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.756095 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.756350 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.756440 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.756656 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.756752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.756969 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.757138 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-6-iscsi {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.757290 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.757423 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.757598 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.757693 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.757922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.758015 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.758230 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.758358 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.758670 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.758762 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.758981 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.759075 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.759302 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.759387 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.759625 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.759719 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.759936 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.760027 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.760285 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.760384 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.760601 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.760700 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.760917 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.761019 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.761227 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.761324 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.761527 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.761622 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.761837 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.761929 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.762146 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.762240 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-6-iscsi {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.762465 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.762557 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.762769 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.762863 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.763074 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.763169 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.763325 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.763652 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.764108 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.764108 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.764322 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.764402 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.764560 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.764651 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.764800 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.764896 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.765122 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.765214 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.765439 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.765536 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.765759 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.765851 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.766070 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.766162 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.766381 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.766483 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.766694 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.766808 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.766999 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.767095 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.767304 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.767406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.767612 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.767718 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.767920 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.768026 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.768250 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.768357 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.768569 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.768663 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.768821 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.768929 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.769130 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.769218 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.769454 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.769552 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.769777 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.769863 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.770102 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.770198 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.770357 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.770450 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.770612 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.770712 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.770935 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.771044 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.771265 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.771359 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.771580 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.771675 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.771892 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.771996 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.772219 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.772309 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.772535 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.772630 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.772847 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.772939 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.773157 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.773251 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.773466 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.773559 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.773777 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.773864 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.774099 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.774193 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.774350 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.774436 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.774657 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.774750 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.774966 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.775057 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.775288 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.775385 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.775595 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.775732 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.775902 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.775994 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.776236 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.776337 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.776540 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.776632 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.776849 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.776956 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.777155 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.777242 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.777462 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.777551 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.777770 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.777864 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.778078 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.778174 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.778383 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.778478 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.778689 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.778785 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.779524 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.779801 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.780261 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.780377 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.780501 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.780624 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.780624 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.780787 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.780878 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.780963 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.781158 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.781245 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.781481 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.781573 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.781794 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.781888 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.782104 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.782199 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.782410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.782502 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.782714 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.782799 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.783026 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.783123 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.783331 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.783424 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.783639 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.783733 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.783946 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.784032 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.784274 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.784362 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.784583 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.784678 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.784896 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.784993 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.785196 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.785287 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.785503 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.785598 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.785822 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.785910 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.786130 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.786215 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.786437 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.786530 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.786742 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.786827 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.787048 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.787150 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.787353 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.787438 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.787659 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.787757 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.787963 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.788050 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.788290 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.788398 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.788591 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.788675 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.788910 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.789007 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.789213 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.789308 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.789525 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.789610 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.789831 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.789922 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.790136 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.790230 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.790454 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.790545 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.790757 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.790850 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.791067 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.791163 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.791387 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.791481 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.791696 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.791782 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.792071 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.792158 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.792432 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.792519 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.792741 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.792824 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.793049 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.793137 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.793356 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.793445 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.793662 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.793747 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.793969 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.794059 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.794270 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.794356 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.794581 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.795408 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.795408 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.795950 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.796031 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.796108 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.796219 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.796326 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.796408 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.796583 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.796672 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:04:14.796904 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.796990 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.797229 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.797320 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.797544 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.797644 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.797865 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.797959 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.798197 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.798329 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.798520 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.798606 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.798834 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.798930 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.799175 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.799263 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.799522 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.799617 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.799839 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.799933 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.800154 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.800296 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.800494 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.800582 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.800811 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.800897 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.801121 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.801216 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.801433 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.801527 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.801758 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.801865 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.802080 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.802167 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.802390 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.802485 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.802712 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.802814 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.803021 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.803107 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.803332 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.803419 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.803645 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.803749 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.803959 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.804047 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.804294 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.804386 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.804631 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.804732 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.804949 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.805037 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.805264 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.805352 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.805576 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.805666 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.805897 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.805994 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.806212 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.806306 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.806525 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.806612 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.806836 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.806929 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.807142 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.807230 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.807448 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.807536 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.807751 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.807838 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.808065 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.808153 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.808397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.808486 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.808710 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.808803 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.809026 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.809129 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.809331 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.809471 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.809643 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.809730 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.809958 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.810057 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.810307 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.810470 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.810965 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.811057 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.811137 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.811233 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.811314 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.811417 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.811532 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.811736 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.811838 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.812052 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.812149 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.812389 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.812477 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.812718 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.812817 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.813036 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.813126 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.813347 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.813432 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.813654 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.813750 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.813965 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.814050 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.814272 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.814358 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.814587 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.814680 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.814898 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.814990 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.815212 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.815307 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.815523 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.815667 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.815834 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.815927 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.816144 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.816249 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.816473 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.816562 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.816784 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.816868 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.817097 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.817181 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.817407 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.817501 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.817733 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.817819 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.818050 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.818136 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.818361 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.818488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.818678 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.818762 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.818986 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.819071 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.819295 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.819389 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.819598 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.819684 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.819904 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.819992 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.820227 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.820318 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.820540 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.820627 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.820849 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.820947 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.821155 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.821461 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.821657 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.821751 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.821978 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.822065 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.822320 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.822407 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.822657 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.822742 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.822959 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.823045 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.823265 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.823351 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.823572 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.823671 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.823912 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.823998 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.824239 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.824327 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.824563 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.824662 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.824873 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.824959 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.825183 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.825268 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.825493 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.825598 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.825810 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.825900 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.826536 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.826644 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.826644 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.826778 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.826963 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.827062 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.827278 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.827366 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.827591 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.827686 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.827911 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.828005 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.828250 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.828341 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.828568 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.828701 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.828878 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.828966 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.829188 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.829287 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.829500 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.829594 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.829824 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.829911 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.830133 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.830227 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.830452 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.830548 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.830799 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.830886 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.831125 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.831217 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.831441 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.831531 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.831761 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.831846 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.832070 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.832195 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.832410 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.832495 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.832720 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.832817 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.833034 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.833131 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.833347 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.833434 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.833662 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.833753 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.833980 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.834082 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.834293 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.834380 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.834614 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.834701 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.834924 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.835091 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.835245 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.835337 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.835552 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.835645 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.835869 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.835963 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.836192 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.836281 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.836506 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.836592 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.836834 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.836923 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.837169 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.837256 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.837483 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.837567 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.837792 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.837879 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.838104 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.838189 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.838412 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.838506 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.838723 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.838817 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.839037 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.839132 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.839344 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.839430 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.839650 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.839745 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.839962 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.840050 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.840303 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.840408 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.840619 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.840707 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.840930 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.841016 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.841234 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.841332 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.842094 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.842687 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.842777 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.842857 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.842935 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.843029 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.843110 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.843188 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.843357 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.843445 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.843672 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.843769 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.843983 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.844074 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.844324 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.844425 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.844646 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.844734 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.844950 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.845034 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.845255 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.845350 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.845562 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.845649 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.845876 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.845971 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.846182 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.846275 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.846489 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.846576 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.846796 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.846889 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.847100 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.847193 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.847416 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.847511 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.847727 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.847823 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.848032 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.848126 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.848362 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.848450 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.848676 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.848761 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.848992 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.849093 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.849303 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.849388 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.849612 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.849704 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.849935 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.850030 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.850244 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.850329 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.850550 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.850635 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.850858 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.850958 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.851172 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.851257 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.851479 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.851573 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.851787 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.851873 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.852090 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.852193 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.852437 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.852533 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.852748 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.852835 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.853052 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.853136 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.853399 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.853491 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.853667 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.853755 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.853983 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.854114 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.854301 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.854551 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.854647 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.854892 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.854978 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.855214 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.855308 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.855538 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.855623 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.856108 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.856230 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.856472 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.856562 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.856769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.856862 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.857086 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.858115 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.858213 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.858294 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.858389 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.858482 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.858570 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.858649 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.858855 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.858942 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.859170 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.859267 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.859480 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.859574 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.859784 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.859909 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.860091 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.860212 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.860423 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.860677 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.860769 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.861012 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.861098 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.861328 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.861423 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.861635 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.861722 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.861942 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.862059 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.862257 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.862344 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.862562 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.862649 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.862873 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.863033 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.863181 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.863278 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.863510 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.863614 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.863823 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.863919 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.864130 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.864252 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.864462 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.864548 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.864769 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.864856 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.865074 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.865168 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.865382 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.865468 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.865690 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.865776 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.866003 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.866132 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.866310 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.866396 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.866617 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.866712 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.866924 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.867026 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.867230 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.867317 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.867545 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.867640 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.867851 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.867936 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.868152 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.868268 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.868480 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.868578 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.868789 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.868875 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.869094 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.869181 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.869397 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.869492 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.869706 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.869792 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.870008 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.870093 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.870316 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.870402 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.870621 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.870708 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.870938 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.871040 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.871242 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.871330 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.871558 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.871645 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.871867 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.871962 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.872211 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.872313 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.872495 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.872582 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.872867 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.873383 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.873552 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.873636 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.873715 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.873793 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.873881 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.873969 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.874183 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.874322 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.874497 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.874585 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.874811 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.874908 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.875114 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.875199 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.875420 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.875514 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.875731 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.875834 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.876037 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.876123 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.876365 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.876463 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.876670 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.876764 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.876990 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.877087 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.877294 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.877391 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.877598 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.877684 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.877905 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.878031 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.878210 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.878303 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.878516 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.878604 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.878820 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.878913 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.879134 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.879272 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.879441 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.879529 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.879744 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.879838 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.880051 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.880145 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.880381 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.880500 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.880687 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.880815 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.881001 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.881121 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.881315 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.881433 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.881620 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.881738 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.881946 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.882041 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.882260 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.882348 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.882568 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.882653 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.882873 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.882968 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.883187 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.883274 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.883495 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.883582 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.883803 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.883902 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.884107 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.884224 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.884440 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.884528 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.884764 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.884852 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.885071 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.885157 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.885385 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.885479 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.885695 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.885784 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.886005 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.886091 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.886313 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.886408 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.886624 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.886711 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.886930 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.887016 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.887236 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.887323 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.887539 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.887626 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.887842 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.887930 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.888148 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.888278 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.888547 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.889016 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.889119 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.889202 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.889328 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.889500 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.889584 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.889663 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.889740 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.889853 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.890006 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.890204 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.890328 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.890515 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.890651 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.890876 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.890962 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.891189 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.891276 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.891507 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.891601 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.891830 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.891924 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.892146 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.892304 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.892477 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.892564 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.892788 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.892890 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.893101 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.893188 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.893413 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.893500 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.893726 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.893822 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.894040 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.894130 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.894353 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.894475 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.894662 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.894759 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.894975 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.895062 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.895286 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.895391 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.895592 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.895688 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.895917 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.896004 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.896252 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.896355 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.896561 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.896649 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.896871 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.896964 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.897182 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.897269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.897497 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.897590 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.897800 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.897885 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.898111 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.898225 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.898426 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.898538 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.898741 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.898850 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.899059 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.899147 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.899375 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.899463 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.899692 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.899785 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.900007 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.900102 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.900343 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.900431 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.900657 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.900752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.900972 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.901094 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.901279 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.901407 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.901606 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.901721 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.901921 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.902015 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.902231 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.902326 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.902545 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.902639 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.902854 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.902949 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.903168 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.903258 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.903477 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.903563 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.903804 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.903890 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.904755 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.905139 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.905139 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.905286 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.905391 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.905473 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.905651 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.905738 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.905966 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.906061 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.906288 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.906375 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.906607 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.906692 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.906917 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.907056 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.907336 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.907425 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.907651 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.907738 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.907966 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.908061 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.908304 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.908393 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.908614 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.908702 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.908920 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.909013 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.909231 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.909317 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.909542 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.909627 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.909851 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.909944 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.910157 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.910244 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.910462 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.910556 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.910777 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.910870 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.911080 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.911165 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.911403 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.911488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.911723 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.911901 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.912037 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.912137 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.912384 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.912474 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.912799 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.912888 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.913125 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.913224 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.913435 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.913528 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.913758 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.913852 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.914081 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.914169 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.914386 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.914471 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.914691 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.914779 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.915002 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.915090 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.915307 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.915393 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.915611 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.915698 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.915931 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.916020 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.916261 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.916362 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.916574 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.916671 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.916882 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.916968 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.917189 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.917282 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.917496 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.917597 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.917802 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.917889 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.918121 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.918215 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.918428 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.918524 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.918750 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.918844 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.919065 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.919152 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.919387 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.919486 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.920330 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.920934 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.921027 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.921115 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.921206 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.921288 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.921374 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.921454 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.921533 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.921766 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.921864 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.922070 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.922164 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.922394 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.922480 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.922705 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.922801 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.923019 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.923153 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.923334 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.923422 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.923648 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.923744 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.923957 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.924043 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.924299 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.924389 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.924628 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.924716 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.924934 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.925020 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.925252 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.925337 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.925566 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.925653 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.925869 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.925954 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.926174 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.926260 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.926486 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.926581 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.926793 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.926879 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.927099 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.927185 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.927403 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.927491 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.927710 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.927795 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.928015 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.928109 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.928341 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.928428 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.928648 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.928748 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.928970 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.929065 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.929275 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.929361 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.929597 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.929683 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.929907 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.930073 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.930211 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.930306 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.930517 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.930644 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.930822 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.930922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.931167 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.931252 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.931470 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.931557 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.931786 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.931873 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.932092 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.932198 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.932429 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.932516 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.932739 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.932828 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.933047 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.933133 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.933357 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.933443 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.933672 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.933762 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.933979 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.934064 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.934291 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.934376 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.934596 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.934689 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.934909 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.935003 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.935226 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.935327 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.935834 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.935933 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.936015 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.936098 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.936240 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.936379 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.936470 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.936702 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.936789 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.937025 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.937112 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.937389 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.937545 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.937724 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.937876 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.938043 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.938194 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.938368 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.938513 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.938699 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.938830 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.939012 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.939148 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.939338 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.939464 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.939657 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.939779 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.939978 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.940078 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.940317 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.940407 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.940634 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.940772 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.940954 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.941056 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.941274 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.941360 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.941591 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.941685 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.941906 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.941994 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.942223 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.942311 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.942540 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.942626 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.942860 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.942948 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.943208 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.943384 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.943564 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.943716 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.943880 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.944037 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.944216 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.944391 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.944532 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.944709 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.944852 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.945027 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.945169 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.945343 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.945483 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.945659 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.945796 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.945973 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.946112 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.946287 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.946427 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.946601 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.946739 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.946932 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.947051 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.947256 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.947352 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.947586 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.947681 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.947924 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.948011 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.948269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.948371 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.948591 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.948686 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.948910 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.949005 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.949226 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.949328 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.949540 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.949626 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.949885 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.950059 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.950194 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.950379 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.950511 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.950714 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.950861 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.951180 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.951647 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.951742 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.951824 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.951903 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.951971 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.952070 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.952236 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.952415 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.952572 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.952729 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.952884 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.953044 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.953193 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.953359 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.953507 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.953676 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.953822 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.954002 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.954130 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.954342 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.954453 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.954666 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.954754 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.954983 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.955111 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.955301 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.955387 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.955620 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.955716 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.956139 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.956263 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.956484 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.956571 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.956820 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.956915 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.957150 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.957238 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.957475 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.957568 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.957791 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.957891 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.958099 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.958192 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.958423 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.958508 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.958728 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.958825 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.959034 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.959120 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.959346 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.959440 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.959656 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.959744 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.959959 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.960045 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.960285 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.960374 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.960601 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.960690 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.960906 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.960992 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.961214 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.961299 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.961526 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.961621 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.961831 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.962058 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.962154 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.962403 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.962491 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.962720 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.962806 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.963033 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.963131 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.963347 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.963442 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.963655 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.963742 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.963965 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.964050 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.964291 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.964380 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.964599 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.964686 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.964912 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.965008 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.965215 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.965303 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.965526 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.965620 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.965830 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.965915 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.966138 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.966226 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.966442 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.967049 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.967273 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.967735 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.967822 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.967909 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.967990 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.968083 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.968228 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.968336 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.968540 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.968636 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.968860 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.968991 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.969176 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.969274 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.969487 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.969573 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.969802 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.969890 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.970109 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.970203 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.970417 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.970505 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.970726 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.970813 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.971035 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.971284 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.971371 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.971623 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.971711 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.971945 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.972041 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.972282 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.972373 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.972600 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.972689 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.972906 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.973006 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.973215 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.973309 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.973526 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.973659 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.973855 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.973960 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.974170 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.974258 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.974476 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.974562 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.974790 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.974876 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.975100 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.975186 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.975410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.975498 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.975724 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.975813 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.976034 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.976121 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.976372 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.976471 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.976688 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.976784 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.977003 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.977317 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.977402 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.977629 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.977725 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.977945 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.978033 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.978264 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.978351 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.978608 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.978696 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.978917 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.979003 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.979228 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.979314 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.979538 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.979632 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.979856 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.979943 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.980262 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.980364 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.980506 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.980593 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.981074 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.981221 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.981387 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.981488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.981701 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.981789 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.982017 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.982165 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.982442 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.982805 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.982889 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.982969 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.983047 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.983210 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.983325 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.983528 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.983641 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.983853 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.983944 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.984195 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.984300 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.984517 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.984605 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.984845 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.984933 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.985174 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.985316 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.985493 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.985584 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.985818 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.985905 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.986135 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.986233 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.986471 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.986565 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.986787 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.986874 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.987102 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.987191 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.987417 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.987504 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.987739 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.987826 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.988046 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.988133 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.988391 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.988480 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.988701 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.988786 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.989021 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.989117 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.989336 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.989423 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.989645 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.989808 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.989953 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.990041 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.990269 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.990356 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.990577 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.990672 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.990885 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.990972 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.991194 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.991281 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.991502 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.991597 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.991813 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.991900 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.992118 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.992249 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.992450 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.992552 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.992756 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.992879 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.993061 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.993210 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.993367 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.993520 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.993670 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.993829 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.993982 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.994222 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.994318 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.994549 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.994645 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.994868 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.994954 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.995172 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.995269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.995479 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.995578 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.995783 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.995869 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.996097 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.996211 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.996433 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.996529 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.996744 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.996831 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.997054 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.997142 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.997364 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.997459 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.997677 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.998275 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.998816 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.998904 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.998984 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.999063 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.999142 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.999220 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.999372 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.999466 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.999678 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.999768 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:14.999983 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.000079 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.000318 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.000409 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.000627 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.000717 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.000936 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.001033 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.001242 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.001372 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.001548 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.001636 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.001856 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.001954 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.002192 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.002280 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.002529 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.002615 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.002848 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.002946 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.003167 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.003253 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.003479 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.003572 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.003796 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.003882 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.004106 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.004211 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.004458 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.004557 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.004775 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.004861 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.005087 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.005174 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.005401 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.005511 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.005712 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.005802 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.006025 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.006112 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.006340 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.006434 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.006655 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.006742 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.006970 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.007057 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.007283 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.007379 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.007593 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.007679 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.007921 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.008005 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.008267 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.008371 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.008578 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.008664 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.008908 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.008994 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.009230 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.009331 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.009557 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.009644 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.009870 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.009955 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.010183 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.010270 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.010488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.010573 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.010731 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 21:04:15.010819 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.011121 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.011442 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.011755 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.012069 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.012415 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.012736 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.013068 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.013515 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.013515 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.014099 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.014430 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.014781 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.015103 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.015451 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.015784 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.016102 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.016446 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.016756 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:04:15.017003 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 21:04:15.072332 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO dbcounter [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] Registered counter for database nova_api Jun 16 21:04:15.079886 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO dbcounter [None req-00d72c99-57d2-4637-a934-32a865623051 None None] Registered counter for database nova_api Jun 16 21:04:15.092766 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG oslo_db.sqlalchemy.engines [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 21:04:15.099303 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writer thread running {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 21:04:15.100068 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_db.sqlalchemy.engines [None req-00d72c99-57d2-4637-a934-32a865623051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 21:04:15.106641 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writer thread running {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 21:04:15.156541 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.context [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),29bf6cc7-f6d0-45cb-a745-0a1e3d896f66(cell1) {{(pid=103369) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 21:04:15.160627 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:04:15.162216 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:04:15.163022 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:04:15.163335 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.context [None req-00d72c99-57d2-4637-a934-32a865623051 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),29bf6cc7-f6d0-45cb-a745-0a1e3d896f66(cell1) {{(pid=103368) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 21:04:15.165005 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG oslo_concurrency.lockutils [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:04:15.166991 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO dbcounter [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] Registered counter for database nova_cell0 Jun 16 21:04:15.167397 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-00d72c99-57d2-4637-a934-32a865623051 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:04:15.169132 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-00d72c99-57d2-4637-a934-32a865623051 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:04:15.170476 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-00d72c99-57d2-4637-a934-32a865623051 None None] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:04:15.171666 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO dbcounter [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] Registered counter for database nova_cell1 Jun 16 21:04:15.172416 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-00d72c99-57d2-4637-a934-32a865623051 None None] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:04:15.174400 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO dbcounter [None req-00d72c99-57d2-4637-a934-32a865623051 None None] Registered counter for database nova_cell0 Jun 16 21:04:15.178260 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO dbcounter [None req-00d72c99-57d2-4637-a934-32a865623051 None None] Registered counter for database nova_cell1 Jun 16 21:04:15.180011 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG oslo_db.sqlalchemy.engines [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 21:04:15.181888 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG oslo_db.sqlalchemy.engines [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 21:04:15.185271 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_db.sqlalchemy.engines [None req-00d72c99-57d2-4637-a934-32a865623051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 21:04:15.188097 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writer thread running {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 21:04:15.189626 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_db.sqlalchemy.engines [None req-00d72c99-57d2-4637-a934-32a865623051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 21:04:15.191131 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writer thread running {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 21:04:15.331031 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writer thread running {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 21:04:15.333953 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writer thread running {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 21:04:15.340894 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO dbcounter [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] Registered counter for database nova_cell0 Jun 16 21:04:15.343441 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO dbcounter [None req-00d72c99-57d2-4637-a934-32a865623051 None None] Registered counter for database nova_cell0 Jun 16 21:04:15.350929 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG oslo_db.sqlalchemy.engines [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 21:04:15.354344 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_db.sqlalchemy.engines [None req-00d72c99-57d2-4637-a934-32a865623051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 21:04:15.355626 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writer thread running {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 21:04:15.359721 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writer thread running {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 21:04:15.698304 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: WARNING keystonemiddleware.auth_token [None req-00d72c99-57d2-4637-a934-32a865623051 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 21:04:15.702520 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: WARNING keystonemiddleware.auth_token [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 21:04:15.705510 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: WARNING keystonemiddleware.auth_token [None req-00d72c99-57d2-4637-a934-32a865623051 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 21:04:15.709699 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: WARNING keystonemiddleware.auth_token [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 21:04:16.044452 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: WARNING keystonemiddleware.auth_token [None req-00d72c99-57d2-4637-a934-32a865623051 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 21:04:16.050471 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: WARNING keystonemiddleware.auth_token [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 21:04:16.050847 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: WARNING keystonemiddleware.auth_token [None req-00d72c99-57d2-4637-a934-32a865623051 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 21:04:16.056047 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56281a5599c0 pid: 103368 (default app) Jun 16 21:04:16.056445 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: WARNING keystonemiddleware.auth_token [None req-354bb279-1889-46a8-981a-f2d624e9e648 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 21:04:16.058126 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-00d72c99-57d2-4637-a934-32a865623051 None None] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:04:16.059320 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-00d72c99-57d2-4637-a934-32a865623051 None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001750 Jun 16 21:04:16.059731 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Thu Jun 16 21:04:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:04:16.062180 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56281a5599c0 pid: 103369 (default app) Jun 16 21:05:33.298169 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-00d72c99-57d2-4637-a934-32a865623051 None None] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:05:33.299191 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-00d72c99-57d2-4637-a934-32a865623051 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 16 21:05:33.299586 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 16 21:05:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:05:33.316484 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writing DB stats nova_api:SELECT=3 {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:33.317488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writing DB stats nova_cell0:SELECT=3 {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:33.318731 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writing DB stats nova_cell1:SELECT=3 {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:33.319830 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:33.752884 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-a1643192-efec-41f8-85d4-c4bf88c9823e admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:05:33.783513 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-a1643192-efec-41f8-85d4-c4bf88c9823e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.477129 Jun 16 21:05:33.784273 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1291 bytes} [Thu Jun 16 21:05:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:05:36.061495 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-00d72c99-57d2-4637-a934-32a865623051 None None] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:05:36.062498 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-00d72c99-57d2-4637-a934-32a865623051 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001955 Jun 16 21:05:36.062895 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 16 21:05:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:05:36.126729 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-69fe98f3-8cc8-4eb2-a20e-a3db6a014f91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "rxtx_factor": 1.0, "ram": 256, "name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:36.145323 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:05:36.145323 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: warnings.warn(msg) Jun 16 21:05:36.178371 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-69fe98f3-8cc8-4eb2-a20e-a3db6a014f91 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109112 Jun 16 21:05:36.179255 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 16 21:05:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:05:36.194286 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writing DB stats nova_api:SELECT=3 {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:36.195762 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writing DB stats nova_cell0:SELECT=3 {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:36.197372 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writing DB stats nova_cell1:SELECT=3 {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:36.198461 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:36.414812 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-4783b481-dabf-4b11-b0ee-3b48c4ae0ea0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:36.417484 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:05:36.417484 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: warnings.warn(msg) Jun 16 21:05:36.482652 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-4783b481-dabf-4b11-b0ee-3b48c4ae0ea0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293223 Jun 16 21:05:36.492573 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1335 bytes} [Thu Jun 16 21:05:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:05:38.714907 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-69fe98f3-8cc8-4eb2-a20e-a3db6a014f91 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:05:38.717070 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-69fe98f3-8cc8-4eb2-a20e-a3db6a014f91 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002592 Jun 16 21:05:38.717643 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 16 21:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:05:38.836194 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-86e4c6fa-aec9-4c29-a4ce-5575adeb8a79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1", "vcpus": 1, "name": "ds512M", "disk": 5}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:38.860824 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:05:38.860824 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: warnings.warn(msg) Jun 16 21:05:38.880661 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-86e4c6fa-aec9-4c29-a4ce-5575adeb8a79 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157324 Jun 16 21:05:38.881165 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 16 21:05:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:05:38.893076 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-3a556a19-5dcd-44f2-a1d6-3aceafff9f19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:38.894548 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:05:38.894548 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: warnings.warn(msg) Jun 16 21:05:38.927599 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-3a556a19-5dcd-44f2-a1d6-3aceafff9f19 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038074 Jun 16 21:05:38.928113 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1335 bytes} [Thu Jun 16 21:05:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:05:41.308372 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-86e4c6fa-aec9-4c29-a4ce-5575adeb8a79 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:05:41.310526 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-86e4c6fa-aec9-4c29-a4ce-5575adeb8a79 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002636 Jun 16 21:05:41.311080 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 16 21:05:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:05:41.373968 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-f7d7f7ea-4a4a-4200-af36-cb549e154bba admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "ram": 1024, "disk": 10, "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:41.394053 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-f7d7f7ea-4a4a-4200-af36-cb549e154bba admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076873 Jun 16 21:05:41.394905 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 16 21:05:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 21:05:41.407707 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-e3679bc6-20a8-4ed3-9596-cb56424e5cad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:41.433191 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-e3679bc6-20a8-4ed3-9596-cb56424e5cad admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029932 Jun 16 21:05:41.433889 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1335 bytes} [Thu Jun 16 21:05:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:05:43.630249 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-f7d7f7ea-4a4a-4200-af36-cb549e154bba admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:05:43.631479 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-f7d7f7ea-4a4a-4200-af36-cb549e154bba admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001654 Jun 16 21:05:43.632115 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 16 21:05:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:05:43.703441 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-0754404a-7c29-4b7f-94d4-fb2081c677db admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G"}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:43.722435 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-0754404a-7c29-4b7f-94d4-fb2081c677db admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083713 Jun 16 21:05:43.723132 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 16 21:05:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:05:43.736420 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-776521ee-e467-4abc-beaf-e774ccc857d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:43.761126 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-776521ee-e467-4abc-beaf-e774ccc857d0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028966 Jun 16 21:05:43.762664 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1335 bytes} [Thu Jun 16 21:05:43 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:05:45.992297 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-0754404a-7c29-4b7f-94d4-fb2081c677db admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:05:45.993707 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-0754404a-7c29-4b7f-94d4-fb2081c677db admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001855 Jun 16 21:05:45.996217 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 16 21:05:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:05:46.055454 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-14576e7b-a89a-4a8d-b0a5-c6f733bda725 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:46.077930 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-14576e7b-a89a-4a8d-b0a5-c6f733bda725 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076621 Jun 16 21:05:46.079066 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 16 21:05:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:05:46.091076 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-4cb2e32b-31b0-4f6b-aa6f-1c93e3198844 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:46.114590 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-4cb2e32b-31b0-4f6b-aa6f-1c93e3198844 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027425 Jun 16 21:05:46.115429 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1335 bytes} [Thu Jun 16 21:05:46 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:05:48.319657 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-14576e7b-a89a-4a8d-b0a5-c6f733bda725 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:05:48.320839 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-14576e7b-a89a-4a8d-b0a5-c6f733bda725 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Jun 16 21:05:48.321246 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 16 21:05:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:05:48.385171 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-10ef7717-bc96-4ba8-a6e7-b1005d24d366 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:05:48.409453 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-10ef7717-bc96-4ba8-a6e7-b1005d24d366 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082060 Jun 16 21:05:48.410112 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1291 bytes} [Thu Jun 16 21:05:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:05:50.660574 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-14576e7b-a89a-4a8d-b0a5-c6f733bda725 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:05:50.661585 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-14576e7b-a89a-4a8d-b0a5-c6f733bda725 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jun 16 21:05:50.661990 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 16 21:05:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:05:50.757129 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-3047bf5e-3cb3-470a-8bca-f86bdfdf8f9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "id": "1", "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:50.777146 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-3047bf5e-3cb3-470a-8bca-f86bdfdf8f9a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.108959 Jun 16 21:05:50.778860 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 16 21:05:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 21:05:50.792331 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-0f172a69-d8e3-46a4-af5a-452a662d674e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:50.815965 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-0f172a69-d8e3-46a4-af5a-452a662d674e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027409 Jun 16 21:05:50.816595 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1332 bytes} [Thu Jun 16 21:05:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:05:52.986289 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-3047bf5e-3cb3-470a-8bca-f86bdfdf8f9a admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:05:52.987669 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-3047bf5e-3cb3-470a-8bca-f86bdfdf8f9a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001940 Jun 16 21:05:52.988251 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 16 21:05:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:05:53.063015 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-6800465c-08c8-4396-a150-80e664db346e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:53.081863 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-6800465c-08c8-4396-a150-80e664db346e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.087246 Jun 16 21:05:53.082441 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 16 21:05:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:05:53.094871 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-a29841bb-264b-4c56-9ca8-83652c99ec89 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:53.119886 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-a29841bb-264b-4c56-9ca8-83652c99ec89 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028418 Jun 16 21:05:53.124577 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1332 bytes} [Thu Jun 16 21:05:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:05:55.422226 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-6800465c-08c8-4396-a150-80e664db346e admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:05:55.423540 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-6800465c-08c8-4396-a150-80e664db346e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001890 Jun 16 21:05:55.424071 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 16 21:05:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:05:55.484454 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-09907798-571d-4389-81f8-fe93336d350e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "id": "3", "vcpus": 2}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:55.505496 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-09907798-571d-4389-81f8-fe93336d350e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075183 Jun 16 21:05:55.506099 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 16 21:05:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:05:55.518419 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-972fca14-6f16-4694-b873-d53e841ac51c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:55.541673 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-972fca14-6f16-4694-b873-d53e841ac51c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026856 Jun 16 21:05:55.542510 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1332 bytes} [Thu Jun 16 21:05:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:05:57.725640 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-09907798-571d-4389-81f8-fe93336d350e admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:05:57.726644 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-09907798-571d-4389-81f8-fe93336d350e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 16 21:05:57.727085 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 16 21:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:05:57.786556 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-1c244b9a-83cd-4549-b2ee-a347923e5c04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "disk": 80}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:57.804875 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-1c244b9a-83cd-4549-b2ee-a347923e5c04 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070858 Jun 16 21:05:57.805442 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 16 21:05:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:05:57.817886 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-218668ab-c3c4-4da3-95a5-7e8f659f09f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:05:57.840840 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-218668ab-c3c4-4da3-95a5-7e8f659f09f6 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026561 Jun 16 21:05:57.841415 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1332 bytes} [Thu Jun 16 21:05:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:06:00.074539 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-1c244b9a-83cd-4549-b2ee-a347923e5c04 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:00.076249 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-1c244b9a-83cd-4549-b2ee-a347923e5c04 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002669 Jun 16 21:06:00.076907 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 16 21:06:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:06:00.142921 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-fca0bc05-9b3f-4481-b1cd-a2e19dcba22e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 160, "rxtx_factor": 1.0, "vcpus": 8, "os-flavor-access:is_public": true, "ram": 16384, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:06:00.162883 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-fca0bc05-9b3f-4481-b1cd-a2e19dcba22e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080310 Jun 16 21:06:00.163429 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 16 21:06:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 21:06:00.175806 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-61c4b95a-d661-402d-96f1-5ba6a7072123 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:06:00.200285 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-61c4b95a-d661-402d-96f1-5ba6a7072123 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028117 Jun 16 21:06:00.208260 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1332 bytes} [Thu Jun 16 21:06:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:06:24.257386 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-fca0bc05-9b3f-4481-b1cd-a2e19dcba22e admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:24.258404 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-fca0bc05-9b3f-4481-b1cd-a2e19dcba22e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 16 21:06:24.258807 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 16 21:06:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:06:24.269986 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:06:24.318536 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-1e6a3c96-9088-468b-941d-a82dec03355c admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:24.335633 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-1e6a3c96-9088-468b-941d-a82dec03355c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070186 Jun 16 21:06:24.336410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1291 bytes} [Thu Jun 16 21:06:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:06:25.302564 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-fca0bc05-9b3f-4481-b1cd-a2e19dcba22e admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:25.303617 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-fca0bc05-9b3f-4481-b1cd-a2e19dcba22e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Jun 16 21:06:25.304018 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 16 21:06:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:06:25.492890 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-3467ed8b-602b-45ea-936e-90bdec4d2ab8 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:25.498529 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.wsgi [None req-3467ed8b-602b-45ea-936e-90bdec4d2ab8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-3467ed8b-602b-45ea-936e-90bdec4d2ab8 admin admin] Request method failure captured: Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Accept: application/json Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Accept-Encoding: gzip, deflate Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Connection: keep-alive Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Content-Length: 0 Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Host: 10.222.0.43 Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Openstack-Api-Version: compute 2.90 Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Openstack-System-Scope: None Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: User-Agent: python-novaclient Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Auth-Token: gAAAAABiq5tRLuRBt41h5MtWazYx90vF6Q7qPpQRF5B_3iLcZawImyDjzcQ2PcQaLAA4KdQOjJF8cgubryeTkurGM6NjnRn5df5iBDQO6vI0OJErajux4Xs9zYRzvg8ErYyDoNmPcPqISnRmd4ww9fbdOHHEOTX7ZDCujxZU9p3n3aUyQZnwZX0 Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Domain-Id: None Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Domain-Name: None Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Identity-Status: Confirmed Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Is-Admin-Project: True Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Project-Domain-Id: default Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Project-Domain-Name: Default Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Project-Id: c0cca612cc8a4e54bb60862d1d2ad94b Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Project-Name: admin Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Role: reader,member,admin Jun 16 21:06:25.501752 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Roles: reader,member,admin Jun 16 21:06:25.503342 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c0cca612cc8a4e54bb60862d1d2ad94b"}]}] Jun 16 21:06:25.503342 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Tenant: admin Jun 16 21:06:25.503342 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Tenant-Id: c0cca612cc8a4e54bb60862d1d2ad94b Jun 16 21:06:25.503342 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Tenant-Name: admin Jun 16 21:06:25.503342 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-User: admin Jun 16 21:06:25.503342 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-User-Domain-Id: default Jun 16 21:06:25.503342 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-User-Domain-Name: Default Jun 16 21:06:25.503342 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-User-Id: 80358824790f4a5498dad87c4c82e1b6 Jun 16 21:06:25.503342 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-User-Name: admin Jun 16 21:06:25.503342 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: method: > Jun 16 21:06:25.503342 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: exception: Flavor 42 could not be found. Jun 16 21:06:25.503342 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: action_args: {'id': '42'} Jun 16 21:06:25.503342 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:06:25.503342 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:06:25.504340 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jun 16 21:06:25.505637 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-3467ed8b-602b-45ea-936e-90bdec4d2ab8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:06:25.506959 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-3467ed8b-602b-45ea-936e-90bdec4d2ab8 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060917 Jun 16 21:06:25.506959 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Thu Jun 16 21:06:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:25.512646 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-651dc267-a2e9-4b1f-88c8-3e9f38188d35 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:25.515572 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:06:25.535128 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-651dc267-a2e9-4b1f-88c8-3e9f38188d35 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026042 Jun 16 21:06:25.535658 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Jun 16 21:06:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:06:25.545934 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-6a56712c-0cbc-418c-ab0d-e5efa2b6f41a admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:25.567417 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-6a56712c-0cbc-418c-ab0d-e5efa2b6f41a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025174 Jun 16 21:06:25.567942 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Jun 16 21:06:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:06:25.578070 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-2bed5056-9b9a-4547-9793-22c005155cd7 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:25.584062 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.wsgi [None req-2bed5056-9b9a-4547-9793-22c005155cd7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-2bed5056-9b9a-4547-9793-22c005155cd7 admin admin] Request method failure captured: Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Accept: application/json Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Accept-Encoding: gzip, deflate Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Connection: keep-alive Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Content-Length: 0 Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Host: 10.222.0.43 Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Openstack-Api-Version: compute 2.90 Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Openstack-System-Scope: None Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: User-Agent: python-novaclient Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Auth-Token: gAAAAABiq5tRLuRBt41h5MtWazYx90vF6Q7qPpQRF5B_3iLcZawImyDjzcQ2PcQaLAA4KdQOjJF8cgubryeTkurGM6NjnRn5df5iBDQO6vI0OJErajux4Xs9zYRzvg8ErYyDoNmPcPqISnRmd4ww9fbdOHHEOTX7ZDCujxZU9p3n3aUyQZnwZX0 Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Domain-Id: None Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Domain-Name: None Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Identity-Status: Confirmed Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Is-Admin-Project: True Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Project-Domain-Id: default Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Project-Domain-Name: Default Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Project-Id: c0cca612cc8a4e54bb60862d1d2ad94b Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Project-Name: admin Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Role: reader,member,admin Jun 16 21:06:25.587291 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Roles: reader,member,admin Jun 16 21:06:25.588922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c0cca612cc8a4e54bb60862d1d2ad94b"}]}] Jun 16 21:06:25.588922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Tenant: admin Jun 16 21:06:25.588922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Tenant-Id: c0cca612cc8a4e54bb60862d1d2ad94b Jun 16 21:06:25.588922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Tenant-Name: admin Jun 16 21:06:25.588922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-User: admin Jun 16 21:06:25.588922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-User-Domain-Id: default Jun 16 21:06:25.588922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-User-Domain-Name: Default Jun 16 21:06:25.588922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-User-Id: 80358824790f4a5498dad87c4c82e1b6 Jun 16 21:06:25.588922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-User-Name: admin Jun 16 21:06:25.588922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: method: > Jun 16 21:06:25.588922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: exception: Flavor 42 could not be found. Jun 16 21:06:25.588922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: action_args: {'id': '42'} Jun 16 21:06:25.588922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:06:25.588922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:06:25.589706 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jun 16 21:06:25.591561 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-2bed5056-9b9a-4547-9793-22c005155cd7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:06:25.593654 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-2bed5056-9b9a-4547-9793-22c005155cd7 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015058 Jun 16 21:06:25.593654 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Thu Jun 16 21:06:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:26.455944 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-6a56712c-0cbc-418c-ab0d-e5efa2b6f41a admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:26.456983 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-6a56712c-0cbc-418c-ab0d-e5efa2b6f41a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 16 21:06:26.457390 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 16 21:06:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:06:26.648689 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-680988ff-9c14-4607-a1a8-f3be2b3cf939 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:26.654787 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.wsgi [None req-680988ff-9c14-4607-a1a8-f3be2b3cf939 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-680988ff-9c14-4607-a1a8-f3be2b3cf939 admin admin] Request method failure captured: Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Accept: application/json Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Accept-Encoding: gzip, deflate Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Connection: keep-alive Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Content-Length: 0 Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Host: 10.222.0.43 Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Openstack-Api-Version: compute 2.90 Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Openstack-System-Scope: None Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: User-Agent: python-novaclient Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Auth-Token: gAAAAABiq5tSr9obf-G_HyShz_3TaCKGaqkqJcbNvLwJWvA0zFNaJaAyeIQbzPwY6dxrUPwEBjORALugKdjfdO34YBz5s-5WICIXPiHp4t85dM7Qi284XJhK7wlp9cfzha7l4G0GQD_RsFv3-zToqowJWTOAq3uUrRCfKO2OUvvoPVdFh_YTjMk Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Domain-Id: None Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Domain-Name: None Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Identity-Status: Confirmed Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Is-Admin-Project: True Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Project-Domain-Id: default Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Project-Domain-Name: Default Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Project-Id: c0cca612cc8a4e54bb60862d1d2ad94b Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Project-Name: admin Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Role: reader,member,admin Jun 16 21:06:26.656406 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Roles: reader,member,admin Jun 16 21:06:26.657702 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c0cca612cc8a4e54bb60862d1d2ad94b"}]}] Jun 16 21:06:26.657702 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Tenant: admin Jun 16 21:06:26.657702 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Tenant-Id: c0cca612cc8a4e54bb60862d1d2ad94b Jun 16 21:06:26.657702 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Tenant-Name: admin Jun 16 21:06:26.657702 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-User: admin Jun 16 21:06:26.657702 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-User-Domain-Id: default Jun 16 21:06:26.657702 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-User-Domain-Name: Default Jun 16 21:06:26.657702 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-User-Id: 80358824790f4a5498dad87c4c82e1b6 Jun 16 21:06:26.657702 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-User-Name: admin Jun 16 21:06:26.657702 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: method: > Jun 16 21:06:26.657702 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: exception: Flavor 84 could not be found. Jun 16 21:06:26.657702 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: action_args: {'id': '84'} Jun 16 21:06:26.657702 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:06:26.657702 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:06:26.660499 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jun 16 21:06:26.661769 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-680988ff-9c14-4607-a1a8-f3be2b3cf939 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:06:26.662867 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-680988ff-9c14-4607-a1a8-f3be2b3cf939 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063311 Jun 16 21:06:26.662867 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Thu Jun 16 21:06:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 21:06:26.667947 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-6cae5da5-6ce6-4c5f-85f1-747a89be14d9 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:26.683587 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-6cae5da5-6ce6-4c5f-85f1-747a89be14d9 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019787 Jun 16 21:06:26.684131 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Jun 16 21:06:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:06:26.693835 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-8af60b81-c968-43de-95f2-8d80a0bdf3eb admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:26.712109 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-8af60b81-c968-43de-95f2-8d80a0bdf3eb admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021472 Jun 16 21:06:26.712713 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Jun 16 21:06:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:06:26.722424 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-042cfff8-c07e-465c-98a4-adcf40c0b679 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:26.728150 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.wsgi [None req-042cfff8-c07e-465c-98a4-adcf40c0b679 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-042cfff8-c07e-465c-98a4-adcf40c0b679 admin admin] Request method failure captured: Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Accept: application/json Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Accept-Encoding: gzip, deflate Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Connection: keep-alive Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Content-Length: 0 Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Host: 10.222.0.43 Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Openstack-Api-Version: compute 2.90 Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Openstack-System-Scope: None Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: User-Agent: python-novaclient Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Auth-Token: gAAAAABiq5tSr9obf-G_HyShz_3TaCKGaqkqJcbNvLwJWvA0zFNaJaAyeIQbzPwY6dxrUPwEBjORALugKdjfdO34YBz5s-5WICIXPiHp4t85dM7Qi284XJhK7wlp9cfzha7l4G0GQD_RsFv3-zToqowJWTOAq3uUrRCfKO2OUvvoPVdFh_YTjMk Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Domain-Id: None Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Domain-Name: None Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Identity-Status: Confirmed Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Is-Admin-Project: True Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Project-Domain-Id: default Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Project-Domain-Name: Default Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Project-Id: c0cca612cc8a4e54bb60862d1d2ad94b Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Project-Name: admin Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Role: reader,member,admin Jun 16 21:06:26.730262 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Roles: reader,member,admin Jun 16 21:06:26.732045 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c0cca612cc8a4e54bb60862d1d2ad94b"}]}] Jun 16 21:06:26.732045 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Tenant: admin Jun 16 21:06:26.732045 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Tenant-Id: c0cca612cc8a4e54bb60862d1d2ad94b Jun 16 21:06:26.732045 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Tenant-Name: admin Jun 16 21:06:26.732045 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-User: admin Jun 16 21:06:26.732045 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-User-Domain-Id: default Jun 16 21:06:26.732045 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-User-Domain-Name: Default Jun 16 21:06:26.732045 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-User-Id: 80358824790f4a5498dad87c4c82e1b6 Jun 16 21:06:26.732045 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-User-Name: admin Jun 16 21:06:26.732045 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: method: > Jun 16 21:06:26.732045 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: exception: Flavor 84 could not be found. Jun 16 21:06:26.732045 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: action_args: {'id': '84'} Jun 16 21:06:26.732045 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:06:26.732045 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:06:26.733103 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jun 16 21:06:26.734488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-042cfff8-c07e-465c-98a4-adcf40c0b679 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:06:26.735934 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-042cfff8-c07e-465c-98a4-adcf40c0b679 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012983 Jun 16 21:06:26.735934 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Thu Jun 16 21:06:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:27.592513 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-8af60b81-c968-43de-95f2-8d80a0bdf3eb admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:27.593519 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-8af60b81-c968-43de-95f2-8d80a0bdf3eb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 16 21:06:27.593947 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 16 21:06:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:06:27.785004 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-457b238a-3ad4-4fe3-bc33-fae1683801a2 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:27.790774 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.wsgi [None req-457b238a-3ad4-4fe3-bc33-fae1683801a2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-457b238a-3ad4-4fe3-bc33-fae1683801a2 admin admin] Request method failure captured: Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Accept: application/json Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Accept-Encoding: gzip, deflate Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Connection: keep-alive Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Content-Length: 0 Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Host: 10.222.0.43 Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Openstack-Api-Version: compute 2.90 Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Openstack-System-Scope: None Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: User-Agent: python-novaclient Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Auth-Token: gAAAAABiq5tTeXw9apt6tfRLPHEgGd29cWjNNRSTatPyFon0-oWsictY7ab1Li24kSALM3vpLCU45msH102hRTf7WcSJSwimWJJpUdYmeP190uH7HEiIpoAV1r4XB3ZuZiHM4MqOOj7rsrmTFC6C9hbuOmmsUH3aTZSpV7JBxMo5N7WMAiIWhbE Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Domain-Id: None Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Domain-Name: None Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Identity-Status: Confirmed Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Is-Admin-Project: True Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Project-Domain-Id: default Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Project-Domain-Name: Default Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Project-Id: c0cca612cc8a4e54bb60862d1d2ad94b Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Project-Name: admin Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Role: reader,member,admin Jun 16 21:06:27.792859 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Roles: reader,member,admin Jun 16 21:06:27.794410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c0cca612cc8a4e54bb60862d1d2ad94b"}]}] Jun 16 21:06:27.794410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Tenant: admin Jun 16 21:06:27.794410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Tenant-Id: c0cca612cc8a4e54bb60862d1d2ad94b Jun 16 21:06:27.794410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-Tenant-Name: admin Jun 16 21:06:27.794410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-User: admin Jun 16 21:06:27.794410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-User-Domain-Id: default Jun 16 21:06:27.794410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-User-Domain-Name: Default Jun 16 21:06:27.794410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-User-Id: 80358824790f4a5498dad87c4c82e1b6 Jun 16 21:06:27.794410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: X-User-Name: admin Jun 16 21:06:27.794410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: method: > Jun 16 21:06:27.794410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: exception: Flavor 451 could not be found. Jun 16 21:06:27.794410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: action_args: {'id': '451'} Jun 16 21:06:27.794410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:06:27.794410 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:06:27.795397 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: ERROR nova.api.openstack.wsgi Jun 16 21:06:27.796879 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-457b238a-3ad4-4fe3-bc33-fae1683801a2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:06:27.798197 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-457b238a-3ad4-4fe3-bc33-fae1683801a2 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062916 Jun 16 21:06:27.798197 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Jun 16 21:06:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:27.803856 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-07e869b4-99ea-4f2e-b877-a9379be8ecf5 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:27.817992 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-07e869b4-99ea-4f2e-b877-a9379be8ecf5 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017809 Jun 16 21:06:27.818509 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Jun 16 21:06:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:06:27.828672 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-2dce3494-88f8-41ab-834a-87e2d4d94208 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:27.842222 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-2dce3494-88f8-41ab-834a-87e2d4d94208 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017084 Jun 16 21:06:27.842747 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Jun 16 21:06:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:06:27.851686 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-754d80f5-7a16-4911-a7c4-b075366c1b82 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:27.857304 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.wsgi [None req-754d80f5-7a16-4911-a7c4-b075366c1b82 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-754d80f5-7a16-4911-a7c4-b075366c1b82 admin admin] Request method failure captured: Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Accept: application/json Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Accept-Encoding: gzip, deflate Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Connection: keep-alive Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Content-Length: 0 Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Host: 10.222.0.43 Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Openstack-Api-Version: compute 2.90 Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Openstack-System-Scope: None Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: User-Agent: python-novaclient Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Auth-Token: gAAAAABiq5tTeXw9apt6tfRLPHEgGd29cWjNNRSTatPyFon0-oWsictY7ab1Li24kSALM3vpLCU45msH102hRTf7WcSJSwimWJJpUdYmeP190uH7HEiIpoAV1r4XB3ZuZiHM4MqOOj7rsrmTFC6C9hbuOmmsUH3aTZSpV7JBxMo5N7WMAiIWhbE Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Domain-Id: None Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Domain-Name: None Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Identity-Status: Confirmed Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Is-Admin-Project: True Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Project-Domain-Id: default Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Project-Domain-Name: Default Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Project-Id: c0cca612cc8a4e54bb60862d1d2ad94b Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Project-Name: admin Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Role: reader,member,admin Jun 16 21:06:27.858793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Roles: reader,member,admin Jun 16 21:06:27.860373 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c0cca612cc8a4e54bb60862d1d2ad94b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c0cca612cc8a4e54bb60862d1d2ad94b"}]}] Jun 16 21:06:27.860373 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Tenant: admin Jun 16 21:06:27.860373 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Tenant-Id: c0cca612cc8a4e54bb60862d1d2ad94b Jun 16 21:06:27.860373 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-Tenant-Name: admin Jun 16 21:06:27.860373 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-User: admin Jun 16 21:06:27.860373 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-User-Domain-Id: default Jun 16 21:06:27.860373 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-User-Domain-Name: Default Jun 16 21:06:27.860373 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-User-Id: 80358824790f4a5498dad87c4c82e1b6 Jun 16 21:06:27.860373 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: X-User-Name: admin Jun 16 21:06:27.860373 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: method: > Jun 16 21:06:27.860373 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: exception: Flavor 451 could not be found. Jun 16 21:06:27.860373 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: action_args: {'id': '451'} Jun 16 21:06:27.860373 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:06:27.860373 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:06:27.861269 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: ERROR nova.api.openstack.wsgi Jun 16 21:06:27.862553 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-754d80f5-7a16-4911-a7c4-b075366c1b82 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:06:27.863754 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-754d80f5-7a16-4911-a7c4-b075366c1b82 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011924 Jun 16 21:06:27.863754 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Jun 16 21:06:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 21:06:28.738050 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-2dce3494-88f8-41ab-834a-87e2d4d94208 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:28.739144 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-2dce3494-88f8-41ab-834a-87e2d4d94208 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 16 21:06:28.739534 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 16 21:06:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:06:28.930255 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-a1f092b2-23a1-44c3-892f-e3af48222f3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:06:28.947694 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-a1f092b2-23a1-44c3-892f-e3af48222f3b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068944 Jun 16 21:06:28.948249 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Thu Jun 16 21:06:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:06:29.807617 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-2dce3494-88f8-41ab-834a-87e2d4d94208 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:29.808657 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-2dce3494-88f8-41ab-834a-87e2d4d94208 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Jun 16 21:06:29.809054 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 16 21:06:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:06:30.000445 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-c749e964-1ffd-4d3c-829e-bd9a20008bc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:06:30.017252 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-c749e964-1ffd-4d3c-829e-bd9a20008bc1 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068236 Jun 16 21:06:30.017790 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Thu Jun 16 21:06:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:06:30.891057 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-2dce3494-88f8-41ab-834a-87e2d4d94208 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:30.892059 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-2dce3494-88f8-41ab-834a-87e2d4d94208 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 16 21:06:30.892488 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 16 21:06:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:06:31.081988 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-63e73ca9-8e34-4883-881b-aad9f97cbae6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:06:31.098796 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-63e73ca9-8e34-4883-881b-aad9f97cbae6 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069330 Jun 16 21:06:31.099337 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Thu Jun 16 21:06:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 21:06:31.979648 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-2dce3494-88f8-41ab-834a-87e2d4d94208 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:31.980682 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-2dce3494-88f8-41ab-834a-87e2d4d94208 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 16 21:06:31.981349 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 16 21:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:06:32.169689 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-f49a4a4f-a1fc-4d6d-b68a-c844b39ae58b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:06:32.187740 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-f49a4a4f-a1fc-4d6d-b68a-c844b39ae58b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070874 Jun 16 21:06:32.188307 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Thu Jun 16 21:06:32 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:06:33.052109 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-2dce3494-88f8-41ab-834a-87e2d4d94208 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:33.053144 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-2dce3494-88f8-41ab-834a-87e2d4d94208 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 16 21:06:33.053541 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 16 21:06:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:06:33.242809 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-bbe23632-5537-441f-bd40-c8d1062e04ee admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:06:33.262527 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-bbe23632-5537-441f-bd40-c8d1062e04ee admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070271 Jun 16 21:06:33.262993 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Thu Jun 16 21:06:33 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:07:22.238785 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-2dce3494-88f8-41ab-834a-87e2d4d94208 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:07:22.239800 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-2dce3494-88f8-41ab-834a-87e2d4d94208 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 16 21:07:22.240225 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 16 21:07:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:07:22.251636 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:07:22.301723 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-501b1565-36b6-405e-bdbf-c5d0f07c8694 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:07:22.322362 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-501b1565-36b6-405e-bdbf-c5d0f07c8694 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075147 Jun 16 21:07:22.322906 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1291 bytes} [Thu Jun 16 21:07:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:07:22.346624 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-92bda4d2-dadf-4e24-addb-3b65d17ad0c2 admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:07:22.350077 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG dbcounter [-] [103369] Writing DB stats nova_api:SELECT=14 {{(pid=103369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:07:22.356730 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-92bda4d2-dadf-4e24-addb-3b65d17ad0c2 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013623 Jun 16 21:07:22.357273 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1282 bytes} [Thu Jun 16 21:07:22 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:07:22.369184 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-e4c8d30c-40f5-4faf-ab7f-b4a2aeae47f5 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:07:22.376846 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-e4c8d30c-40f5-4faf-ab7f-b4a2aeae47f5 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011756 Jun 16 21:07:22.377358 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1285 bytes} [Thu Jun 16 21:07:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:07:22.389005 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-36e81890-daaf-4dc3-a728-aeea68ece8cf admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:07:22.396388 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-36e81890-daaf-4dc3-a728-aeea68ece8cf admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010911 Jun 16 21:07:22.396897 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1285 bytes} [Thu Jun 16 21:07:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:07:22.408727 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-9d17a7d7-53fd-4ba3-86e6-c6d76ec3ce6c admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:07:22.417299 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-9d17a7d7-53fd-4ba3-86e6-c6d76ec3ce6c admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012064 Jun 16 21:07:22.417806 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1282 bytes} [Thu Jun 16 21:07:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:10:56.934499 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-36e81890-daaf-4dc3-a728-aeea68ece8cf admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:10:56.935544 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-36e81890-daaf-4dc3-a728-aeea68ece8cf admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jun 16 21:10:56.935941 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 16 21:10:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:10:57.094793 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writing DB stats nova_api:SELECT=6 {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:10:57.221669 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-552820c9-df26-419e-bc54-42d76295822a admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:10:57.222857 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:10:57.222857 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: warnings.warn(msg) Jun 16 21:10:57.224049 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-552820c9-df26-419e-bc54-42d76295822a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:10:57.224522 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-552820c9-df26-419e-bc54-42d76295822a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:10:57.225320 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-552820c9-df26-419e-bc54-42d76295822a admin admin] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:10:57.225899 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-552820c9-df26-419e-bc54-42d76295822a admin admin] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:10:57.259897 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-552820c9-df26-419e-bc54-42d76295822a admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.166628 Jun 16 21:10:57.260472 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 36/70] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Jun 16 21:10:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:10:58.128834 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-36e81890-daaf-4dc3-a728-aeea68ece8cf admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:10:58.129852 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-36e81890-daaf-4dc3-a728-aeea68ece8cf admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jun 16 21:10:58.130252 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 16 21:10:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:10:58.331985 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-efa6d7bc-fc45-4baf-9c16-80676f535997 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:10:58.334172 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:10:58.334172 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: warnings.warn(msg) Jun 16 21:10:58.335393 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-efa6d7bc-fc45-4baf-9c16-80676f535997 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:10:58.335932 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-efa6d7bc-fc45-4baf-9c16-80676f535997 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:10:58.336838 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-efa6d7bc-fc45-4baf-9c16-80676f535997 admin admin] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:10:58.337268 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-efa6d7bc-fc45-4baf-9c16-80676f535997 admin admin] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:10:58.359298 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-efa6d7bc-fc45-4baf-9c16-80676f535997 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082707 Jun 16 21:10:58.359801 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Jun 16 21:10:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:11:09.665978 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-36e81890-daaf-4dc3-a728-aeea68ece8cf admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:11:09.667024 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-36e81890-daaf-4dc3-a728-aeea68ece8cf admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 16 21:11:09.667424 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 16 21:11:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:11:09.810082 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writing DB stats nova_cell0:SELECT=4 {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:11:09.810814 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writing DB stats nova_cell1:SELECT=4 {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:11:09.811435 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG dbcounter [-] [103368] Writing DB stats nova_api:SELECT=8 {{(pid=103368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:11:09.859872 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-e0a256dd-8965-4c26-93a6-8b735c7eaaec admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:11:09.861085 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:11:09.861085 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: warnings.warn(msg) Jun 16 21:11:09.862304 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-e0a256dd-8965-4c26-93a6-8b735c7eaaec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:11:09.862740 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-e0a256dd-8965-4c26-93a6-8b735c7eaaec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:11:09.863543 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-e0a256dd-8965-4c26-93a6-8b735c7eaaec admin admin] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:11:09.863969 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-e0a256dd-8965-4c26-93a6-8b735c7eaaec admin admin] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:11:09.889314 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-e0a256dd-8965-4c26-93a6-8b735c7eaaec admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083959 Jun 16 21:11:09.889853 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 38/74] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Jun 16 21:11:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:11:10.771653 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: DEBUG nova.api.openstack.wsgi [None req-36e81890-daaf-4dc3-a728-aeea68ece8cf admin admin] Calling method '>' {{(pid=103369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:11:10.772826 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: INFO nova.api.openstack.requestlog [None req-36e81890-daaf-4dc3-a728-aeea68ece8cf admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jun 16 21:11:10.773857 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: [pid: 103369|app: 0|req: 37/75] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 16 21:11:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:11:10.965164 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG nova.api.openstack.wsgi [None req-3b107a40-c103-4ab1-be69-d7cbbee977c3 admin admin] Calling method '>' {{(pid=103368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:11:10.966311 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:11:10.966311 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: warnings.warn(msg) Jun 16 21:11:10.967488 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-3b107a40-c103-4ab1-be69-d7cbbee977c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:11:10.967922 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-3b107a40-c103-4ab1-be69-d7cbbee977c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:11:10.968728 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-3b107a40-c103-4ab1-be69-d7cbbee977c3 admin admin] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:11:10.969144 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: DEBUG oslo_concurrency.lockutils [None req-3b107a40-c103-4ab1-be69-d7cbbee977c3 admin admin] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:11:10.990738 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: INFO nova.api.openstack.requestlog [None req-3b107a40-c103-4ab1-be69-d7cbbee977c3 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079335 Jun 16 21:11:10.991745 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: [pid: 103368|app: 0|req: 39/76] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Jun 16 21:11:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:12:08.717545 dv-cinder-819149-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 21:12:08.719616 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: Thu Jun 16 21:12:08 2022 - graceful shutdown triggered... Jun 16 21:12:08.720097 dv-cinder-819149-6-iscsi devstack@n-api.service[103369]: Gracefully killing worker 2 (pid: 103369)... Jun 16 21:12:08.720539 dv-cinder-819149-6-iscsi devstack@n-api.service[103368]: Gracefully killing worker 1 (pid: 103368)... Jun 16 21:12:09.720307 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: worker 1 buried after 1 seconds Jun 16 21:12:09.720802 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: worker 2 buried after 1 seconds Jun 16 21:12:09.720802 dv-cinder-819149-6-iscsi devstack@n-api.service[103367]: goodbye to uWSGI. Jun 16 21:12:09.721961 dv-cinder-819149-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 21:12:09.722504 dv-cinder-819149-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 21:12:09.725327 dv-cinder-819149-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 21:12:09.735568 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 21:12:09.737676 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 21:12:09 2022] *** Jun 16 21:12:09.737676 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 21:12:09.737676 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 21:12:09.737676 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: nodename: dv-cinder-819149-6-iscsi Jun 16 21:12:09.737676 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: machine: x86_64 Jun 16 21:12:09.737676 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: clock source: unix Jun 16 21:12:09.737676 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: pcre jit disabled Jun 16 21:12:09.737676 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: detected number of CPU cores: 4 Jun 16 21:12:09.737676 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: current working directory: / Jun 16 21:12:09.737676 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: detected binary path: /usr/bin/uwsgi-core Jun 16 21:12:09.737676 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: your processes number limit is 47680 Jun 16 21:12:09.737676 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: your memory page size is 4096 bytes Jun 16 21:12:09.737676 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: detected max file descriptor number: 2048 Jun 16 21:12:09.737676 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: lock engine: pthread robust mutexes Jun 16 21:12:09.738632 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: thunder lock: enabled Jun 16 21:12:09.738632 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 21:12:09.738632 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 21:12:09.783308 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: Python main interpreter initialized at 0x55b36bc1f9c0 Jun 16 21:12:09.783308 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: python threads support enabled Jun 16 21:12:09.783308 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: your server socket listen backlog is limited to 100 connections Jun 16 21:12:09.783308 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: your mercy for graceful operations on workers is 90 seconds Jun 16 21:12:09.783745 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 21:12:09.783745 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: *** Operational MODE: preforking *** Jun 16 21:12:09.784040 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: *** uWSGI is running in multiple interpreter mode *** Jun 16 21:12:09.784040 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: spawned uWSGI master process (pid: 117720) Jun 16 21:12:09.784273 dv-cinder-819149-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 21:12:09.784844 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: spawned uWSGI worker 1 (pid: 117737, cores: 1) Jun 16 21:12:09.785195 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: spawned uWSGI worker 2 (pid: 117738, cores: 1) Jun 16 21:12:09.785464 dv-cinder-819149-6-iscsi devstack@n-api.service[117720]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 21:12:10.446639 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 21:12:10.458433 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 21:12:11.709021 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 21:12:11.709021 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: from cryptography.utils import int_from_bytes Jun 16 21:12:11.709647 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 21:12:11.709647 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: from cryptography.utils import int_from_bytes Jun 16 21:12:11.740257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 21:12:11.740257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: from cryptography.utils import int_from_bytes Jun 16 21:12:11.740757 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 21:12:11.740757 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: from cryptography.utils import int_from_bytes Jun 16 21:12:14.125804 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 21:12:14.126362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 21:12:14.126597 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 21:12:14.126933 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 21:12:14.127184 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 21:12:14.127575 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.127891 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.128232 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.128552 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.128882 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.129191 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.129507 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.129837 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.130152 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.130950 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.130950 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.131139 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-6-iscsi {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.131316 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.131805 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.132115 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.132462 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.132832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.133354 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.133760 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.134261 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.134704 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.135013 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.135325 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.135665 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.135978 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.136308 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.136631 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.136941 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.137263 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.137610 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.137966 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-6-iscsi {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.138279 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.138589 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.138899 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.139311 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.139616 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.139922 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.140273 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.140579 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.140885 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.141223 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.141540 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.141854 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.142169 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.142467 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.142775 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.143082 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.143394 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.143695 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.143994 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.144331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.144640 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.144960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.145276 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.145594 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.145844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.146090 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.146402 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.146717 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.147019 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.147321 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.147624 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.147928 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.148250 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.149254 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.149561 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.149865 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.150182 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.150498 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.150815 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.151119 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.151436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.151833 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.152076 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.152408 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.152745 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.153062 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.153365 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.153680 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.153998 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.154301 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.154604 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.154910 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.155224 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.155556 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.155863 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.156109 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.156430 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.156732 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.157048 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.157351 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.157653 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.157955 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.158252 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.158552 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.158854 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.159157 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.159460 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.159760 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.160059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.160382 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.160687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.160984 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.161301 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.161617 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.161920 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.162223 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.162523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.162823 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.163141 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.163441 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.163743 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.164668 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.164981 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.165286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.165600 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.165910 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.166215 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.166533 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.166831 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.167136 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.167448 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.167753 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.168057 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.168384 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.168685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.168987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.169289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.169591 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.169890 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.170188 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.170503 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.170820 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.171123 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.171426 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.171727 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.172306 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.172407 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.172711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.173053 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.173366 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.173697 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.174026 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.174341 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.174651 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.174963 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.175289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.175597 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.175913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.176242 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.176561 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.176877 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.177208 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.177525 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.177844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.178161 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.178473 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.178788 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.179118 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.179438 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.179774 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.180266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.180483 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.180797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.181119 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.181438 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.181749 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.182062 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.182369 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.182692 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.183020 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.183335 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.183654 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.183963 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.184295 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.184604 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.184913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.185225 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.185557 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.185879 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.186191 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.186503 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.186818 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.187129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.187441 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.187754 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.188061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.188390 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.188694 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.189004 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.189305 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.189622 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.189948 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.190252 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.190583 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.190889 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.191226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.191743 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.192301 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.192874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.193466 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.194050 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.194583 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.195277 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.195834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.196400 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 21:12:14.196833 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.196939 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 21:12:14.197031 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.197187 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 21:12:14.197463 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.197663 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 21:12:14.197953 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 21:12:14.198051 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.198391 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.198568 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.198738 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.198996 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.199151 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.199381 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.199531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.199808 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.200035 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.200196 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.200542 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.200685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.200887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.201134 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.201240 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.201477 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.201615 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.201798 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.201953 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.202138 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-6-iscsi {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.202307 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.202462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.202654 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.202774 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.202974 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.203092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.203311 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.203404 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.203648 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.203762 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.203971 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.204074 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.204307 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.204418 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.204628 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.204863 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.204972 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.205186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.205382 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.205537 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.205704 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.205919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.206077 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.206230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.206383 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.206528 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.206679 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.206823 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.206966 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.207143 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.207289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.207441 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.207602 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.207746 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.207900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.208043 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.208219 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.208384 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.208574 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-6-iscsi {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.208731 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.208903 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.209048 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.209836 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.210007 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.210166 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.210310 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.210476 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.210623 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.210775 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.211499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.211605 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.211700 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.211795 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.211889 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.211987 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.212075 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.212167 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.212294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.212435 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.212532 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.212638 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.212724 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.212815 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.212909 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.213063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.213168 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.213371 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.213477 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.213757 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.213865 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.213992 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.214093 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.214313 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.214406 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.214622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.214729 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.214929 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.215031 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.215182 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.215303 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.215490 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.215609 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.215816 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.215921 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.216140 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.216254 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.216499 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.216595 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.216753 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.216859 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.217004 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.217156 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.217329 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.217470 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.217652 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.217787 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.217963 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.218098 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.218274 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.218409 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.218584 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.218721 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.218892 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.219031 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.219198 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.219349 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.219507 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.219662 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.219815 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.219980 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.220125 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.220314 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.220473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.220637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.220792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.220946 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.221116 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.221265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.221426 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.221587 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.221749 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.221851 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.222149 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.222251 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.222401 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.222541 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.222713 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.222808 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.223057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.223151 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.223382 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.223484 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.223694 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.223794 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.224005 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.224102 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.224340 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.224436 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.224647 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.224741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.224949 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.225057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.225258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.225361 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.225584 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.225707 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.225985 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.226183 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.226284 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.226380 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.226519 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.226630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.226830 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.226948 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.227137 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.227245 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.227465 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.227567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.227775 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.227889 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.228085 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.228230 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.228421 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.228572 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.228714 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.228861 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.229001 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.229147 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.229312 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.229455 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.229606 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.229753 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.229909 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.230211 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.230358 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.230499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.230652 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.230792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.231378 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.231533 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.231715 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.231868 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.232022 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.232211 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.232366 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.232557 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.232707 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.233103 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.233265 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.233409 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.233561 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.233712 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.233855 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.234040 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.234190 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.234332 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.234488 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.234640 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.234804 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.234967 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.235115 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.235256 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.235413 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.235556 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.235707 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.235850 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.236036 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.236292 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.236458 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.236604 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.236748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.236901 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.237044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.237194 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.237194 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.237484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.237484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.237763 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.237914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.238057 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.238057 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.238337 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.238487 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.238630 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.238790 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.238948 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.239102 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.239246 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.239396 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.239540 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.239540 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.239833 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.239984 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.240153 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.240406 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.240551 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.240701 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.240701 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.241002 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.241002 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.241289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.241433 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.241575 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.241575 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.241859 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.242010 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.242189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.242332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.242489 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.242651 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 21:12:14.242804 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.242947 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.243103 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.243247 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.243390 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.243541 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.243683 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.243825 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.243976 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.243976 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.244290 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.244438 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.244592 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.244748 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.244913 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.245068 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.245212 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.245354 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.245496 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.245652 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.245795 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.245937 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.246079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.246240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.246486 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.246651 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.246809 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.246967 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.247123 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.247283 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.247443 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.247593 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.247749 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.247900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.248049 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.248227 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.248403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.248566 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.248723 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.248873 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.249031 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.249180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.249339 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.249488 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.249488 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.249778 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.249927 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.250091 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.250091 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.250479 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.250479 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.250790 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.250940 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.251097 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.251249 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.251398 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.251554 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.251711 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.251885 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.252148 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.252376 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.252530 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.252701 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.252866 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.252979 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.253083 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.253187 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.253277 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.253369 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.253463 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.253561 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.253726 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.253822 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.253915 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.254001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.254085 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.254182 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.254287 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.254381 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.254466 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.254565 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.254652 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.254743 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.254859 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.255029 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.255188 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.255343 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.255493 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.255667 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.255818 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.255978 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.256127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.256323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.256501 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.256739 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.257007 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.257186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.257347 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.257498 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.257654 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.258419 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.258588 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.258897 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.259063 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.259215 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.259374 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.259526 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.259675 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.259825 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.259984 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.260154 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.260362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.260362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.260763 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.260930 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.261088 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.261237 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.261396 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.261559 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.261710 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.261868 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.262026 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.262184 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.262346 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.262496 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.262645 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.262804 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.262954 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.263117 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.263275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.263433 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.263591 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.263748 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.263905 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.264068 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.264245 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.264440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.264594 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.264750 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.264918 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.265078 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.265236 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.265393 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.265543 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.265699 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.265848 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.266009 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.266160 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.266316 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.266466 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.266626 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.266874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.267044 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.267543 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.267695 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.267843 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.267992 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.268156 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.268347 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.268347 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.268683 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.268833 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.268982 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.269144 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.269302 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.269464 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.269622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.269779 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.269973 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.270129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.270280 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.270435 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.270611 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.270843 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.271008 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.271165 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.271328 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.271496 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.271654 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.271811 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.271975 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.272145 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.272332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.272487 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.272681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.272836 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.272995 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.273154 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.273356 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.274088 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.274372 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.274539 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.274697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.274846 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.274996 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.275144 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.275301 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.275464 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.275616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.275765 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.275922 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.276073 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.276251 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.276433 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.276587 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.276746 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.276996 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.277167 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.277328 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.277492 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.277492 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.277786 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.277936 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.278093 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.278251 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.278402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.278569 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.278728 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.278885 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.279035 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.279197 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.279355 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.279505 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.279661 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.279818 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.279976 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.280204 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.280376 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.280534 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.280701 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.280868 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.281088 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.281263 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.281415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.281563 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.281726 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.281878 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.282037 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.282187 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.282335 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.282483 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.282643 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.282792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.282960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.283119 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.283276 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.283426 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.283426 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.283717 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.283717 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.284013 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.284189 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.284358 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.284510 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.284670 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.284829 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.284980 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.285137 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.285294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.285294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.285594 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.285756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.285906 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.286063 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.286275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.286451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.286625 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.286625 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.286934 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.287187 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.287352 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.287503 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.287728 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.287889 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.288039 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.288244 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.288413 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.288413 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.288716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.288874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.289070 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.289225 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.289383 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.289540 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.289705 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.289857 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.290006 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.290154 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.290304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.290465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.290623 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.290773 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.290941 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.291117 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.291347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.291347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.291660 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.291660 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.291954 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.292111 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.292299 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.292465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.292617 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.292766 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.292915 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.293075 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.293225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.293390 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.293548 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.293698 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.293848 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.293996 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.294154 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.294311 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.294468 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.294617 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.294766 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.294923 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.295164 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.295324 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.295476 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.295625 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.295773 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.295921 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.296079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.296290 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.296454 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.296613 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.296774 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.296925 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.297088 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.297345 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.297516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.297675 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.297833 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.297992 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.298143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.298298 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.298456 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.298614 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.298771 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.298931 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.299088 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.299260 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.299411 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.299568 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.299719 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.299876 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.300026 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.300206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.300375 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.300526 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.300684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.300843 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.300993 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.301149 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.301327 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.301556 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.301721 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.301872 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.302029 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.302179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.302336 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.302486 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.302648 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.302800 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.302957 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.303115 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.303265 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.303430 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.303593 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.303847 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.304019 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.304212 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.304371 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.304531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.304725 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.304878 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.305028 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.305176 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.305334 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.305497 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.305667 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.305820 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.305982 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.306133 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.306282 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.306445 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.306603 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.306758 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.306916 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.307074 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.307074 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.307384 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.307384 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.307769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.307927 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.308087 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.308271 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.308440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.308440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.308440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.308878 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.309029 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.309194 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.309346 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.309496 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.309656 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.309813 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.309962 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.310122 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.310280 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.310437 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.310601 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.310759 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.310910 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.311071 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.311230 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.311381 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.311555 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.311730 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.311881 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.311881 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.312210 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.312371 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.312539 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.312689 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.312838 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.312986 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.313143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.313300 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.313465 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.313616 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.313783 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.313935 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.314091 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.314247 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.314411 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.314566 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.314717 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.314872 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.315039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.315274 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.315440 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.315589 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.315757 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.315915 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.316073 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.316262 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.316422 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.316587 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.316749 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.316907 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.317066 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.317228 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.317388 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.317538 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.317775 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.317950 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.318109 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.318277 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.318442 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.318593 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.318751 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.318901 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.319064 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.319215 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.319365 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.319513 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.319672 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.319823 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.319992 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.320143 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.320934 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.321120 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.321320 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.321473 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.321633 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.321793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.321945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.322100 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.322258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.322408 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.322582 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.322735 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.322884 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.322884 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.323175 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.323344 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.323494 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.323644 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.323801 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.323953 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.324115 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.324472 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.324655 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.324831 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.325003 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.325159 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.325316 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.325500 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.325667 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.325849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.326007 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.326173 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.326341 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.326510 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.326690 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.326845 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.327051 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.327204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.327379 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.327534 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.327534 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.327814 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.327970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.328122 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.328325 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.328492 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.328656 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.328810 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.328971 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.329125 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.329293 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.329444 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.329597 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.329597 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.329925 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.330095 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.330095 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.330390 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.330547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.330547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.330844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.331007 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.331007 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.331297 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.331449 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.331449 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.331747 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.331960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.332117 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.333337 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.333337 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.333674 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.333831 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.333831 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.334126 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.334279 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.334279 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.334573 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.334728 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.334728 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.335010 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.335161 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.335334 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.335496 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.335496 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.335785 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.336006 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.336006 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.336329 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.336485 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.336485 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.336765 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.336930 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.336930 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.337235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.337389 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.337389 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.337689 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.337841 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.337841 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.338129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.338291 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.338291 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.338583 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.338745 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.338918 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.339071 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.339071 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.339358 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.339511 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.339511 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.339511 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.339942 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.340107 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.340107 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.340415 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.340566 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.340746 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.340910 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.340910 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.341213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.341376 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.341376 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.341668 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.341821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.341821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.342098 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.342244 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.342244 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.342785 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.342938 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.343089 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.343249 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.343249 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.343657 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.343808 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.343808 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.344088 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.344276 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.344276 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.344580 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.344744 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.344744 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.345022 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.345171 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.345323 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.345486 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.345486 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.345765 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.345936 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.345936 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.346245 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.346409 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.346409 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.346698 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.346849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.346849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.347249 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.347411 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.347559 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.347723 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.347723 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.347723 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.348232 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.348391 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.348391 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.348666 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.348818 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.348818 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.349212 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.349375 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.349375 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.349675 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.349825 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.349825 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.350129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.350294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.350445 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.350594 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.350594 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.350901 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.351066 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.351066 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.351357 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.351991 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.352961 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.353133 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.353133 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.353436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.353572 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.353572 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.353864 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.354027 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.354027 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.354318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.354533 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.354533 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.354924 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.355080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.355242 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.355407 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.355407 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.355708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.355873 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.355873 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.356198 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.356368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.356532 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.356685 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.356900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.357100 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.357291 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.357500 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.357670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.358082 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.358281 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.358449 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.358609 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.358766 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.358917 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.359220 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.359388 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.359553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.359777 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.359939 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.360203 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.360378 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.360533 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.360812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.360985 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.361147 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.361353 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.361531 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.361761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.361918 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.362080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.362357 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.362520 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.362816 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.362948 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.363141 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.363374 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.363548 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.363784 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.363953 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.364107 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.364417 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.364577 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.364740 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.364978 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.365151 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.365315 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.365535 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.365762 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.365953 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.366163 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.366363 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.366549 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.366702 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.366855 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.367827 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.368167 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.368441 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.368692 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.368858 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.368858 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.369151 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.369302 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.369302 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.369583 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.369736 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.369952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.370120 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.370283 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.370555 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.370714 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.370875 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.371098 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.371333 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.371489 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.371648 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.371798 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.372093 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.372340 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.372561 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.372745 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.373172 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.373330 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.373478 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.373688 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.373845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.374028 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.374277 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.374440 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.374661 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.374834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.374987 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.375291 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.375449 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.375611 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.375886 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.376064 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.376286 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.376457 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.376609 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.376815 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.377140 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.377351 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.377509 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.377658 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.377820 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.378012 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.378188 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.378344 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.378599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.378762 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.378926 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.379148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.379330 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.379558 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.379712 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.379863 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.380162 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.380371 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.380539 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.380738 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.380897 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.381119 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.381276 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.381445 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.381761 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.381922 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.382074 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.382300 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.382461 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.382766 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.382925 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.383129 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.383378 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.383607 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.383766 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.384028 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.384221 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.384404 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.384557 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.384771 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.385027 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.385213 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.385377 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.385579 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.385732 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.385953 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.386148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.386308 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.386581 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.386754 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.387120 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.387284 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.387517 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.387788 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.387952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.388106 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.388296 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.388449 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.388717 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.388873 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.389036 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.389295 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.389456 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.389622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.389836 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.390007 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.390219 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.390387 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.390540 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.390866 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.391028 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.391182 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.391423 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.391587 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.391824 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.392001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.392165 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.392475 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.392637 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.392806 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.393139 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.393350 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.393507 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.393754 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.393919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.394072 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.394245 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.394397 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.394670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.394895 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.395050 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.395288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.395459 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.395613 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.395841 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.396015 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.396226 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.396441 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.396602 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.396848 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.397013 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.397179 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.397482 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.397663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.397818 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.398027 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.398187 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.398551 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.398774 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.399103 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.399257 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.399420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.399695 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.399859 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.400025 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.400342 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.400507 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.400694 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.400887 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.401059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.401299 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.401466 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.401620 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.401907 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.402082 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.402246 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.402458 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.402617 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.402828 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.402994 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.403146 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.403439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.403666 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.403900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.404051 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.404278 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.404431 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.404600 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.404765 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.405010 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.405178 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.405557 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.405722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.405894 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.406093 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.406254 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.406546 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.406758 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.406949 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.407158 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.407326 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.407476 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.407693 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.407847 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.408097 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.408355 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.408510 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.408711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.408881 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.409033 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.409249 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.409411 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.409646 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.409803 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.409956 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.410241 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.410419 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.410572 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.410773 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.410933 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.411156 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.411309 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.411477 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.411776 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.411950 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.412162 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.412383 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.412560 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.412713 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.412871 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.413024 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.413298 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.413457 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.413629 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.413873 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.415147 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.415147 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.415438 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.415604 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.415604 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.415907 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.416069 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.416069 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.416413 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.416579 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.416579 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.416877 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.417028 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.417230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.417398 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.417571 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.417835 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.418004 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.418157 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.418379 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.418549 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.418769 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.418937 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.419091 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.419395 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.419568 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.419750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.419976 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.420136 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.420495 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.420657 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.420962 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.421132 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.421398 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.421560 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.421725 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.421940 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.422106 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.422273 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.422557 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.422714 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.422881 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.423117 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.423279 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.423506 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.423659 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.423869 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.424095 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.424276 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.424448 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.424741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.424912 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.425066 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.425296 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.425450 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.425654 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.425855 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.426029 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.426268 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.426437 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.426592 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.426884 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.427044 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.427198 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.427445 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.427618 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.427828 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.428003 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.428167 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.428488 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.428664 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.428828 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.429094 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.429278 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.429456 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.429796 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.429959 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.430128 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.430430 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.430593 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.430748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.430979 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.431142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.431376 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.431546 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.431701 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.432005 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.432168 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.432427 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.432582 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.432754 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.433068 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.433241 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.433395 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.433643 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.433819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.434009 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.434224 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.434383 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.434643 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.434863 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.435040 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.435279 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.435448 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.435600 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.435844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.436136 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.436351 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.436499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.436676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.436873 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.437041 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.437215 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.437485 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.437651 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.437803 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.438105 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.438274 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.438447 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.438674 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.438834 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.439013 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.439228 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.439399 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.439621 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.439787 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.439954 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.440216 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 21:12:14.440372 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.440548 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.440857 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.441166 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.441476 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.441779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.442086 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.442391 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.442705 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.443012 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.443318 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.443628 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.443934 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.444268 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.444604 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.444943 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.445805 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.446143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.446465 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.446794 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.447111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.447467 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.447766 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.448086 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.448429 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.448768 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.449085 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.449403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.449719 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.450039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.450354 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.450672 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.451002 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.451332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.451642 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.451971 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.452318 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.452648 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.452969 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.453288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.453626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.453942 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.454261 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.454583 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.454901 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.455219 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.455541 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.455863 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.456214 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.456578 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.456896 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.457228 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.457561 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.457912 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.458231 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.458580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.458914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.459235 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.459552 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.459864 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 21:12:14.460115 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 21:12:14.510688 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO dbcounter [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] Registered counter for database nova_api Jun 16 21:12:14.524577 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO dbcounter [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] Registered counter for database nova_api Jun 16 21:12:14.530427 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_db.sqlalchemy.engines [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 21:12:14.537261 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writer thread running {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 21:12:14.545076 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 21:12:14.551675 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writer thread running {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 21:12:14.595075 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.context [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),29bf6cc7-f6d0-45cb-a745-0a1e3d896f66(cell1) {{(pid=117737) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 21:12:14.601966 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:12:14.601966 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:12:14.601966 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:12:14.603575 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:12:14.605614 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO dbcounter [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] Registered counter for database nova_cell0 Jun 16 21:12:14.609876 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO dbcounter [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] Registered counter for database nova_cell1 Jun 16 21:12:14.610872 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.context [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),29bf6cc7-f6d0-45cb-a745-0a1e3d896f66(cell1) {{(pid=117738) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 21:12:14.615219 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:12:14.619362 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:12:14.619362 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:12:14.620460 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:12:14.620614 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_db.sqlalchemy.engines [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 21:12:14.621731 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_db.sqlalchemy.engines [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 21:12:14.622520 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO dbcounter [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] Registered counter for database nova_cell0 Jun 16 21:12:14.626450 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO dbcounter [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] Registered counter for database nova_cell1 Jun 16 21:12:14.628587 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writer thread running {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 21:12:14.629875 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writer thread running {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 21:12:14.634615 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 21:12:14.636376 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 21:12:14.641319 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writer thread running {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 21:12:14.776882 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO dbcounter [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] Registered counter for database nova_cell0 Jun 16 21:12:14.782020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writer thread running {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 21:12:14.784713 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_db.sqlalchemy.engines [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 21:12:14.790029 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writer thread running {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 21:12:14.793601 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO dbcounter [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] Registered counter for database nova_cell0 Jun 16 21:12:14.800442 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 21:12:14.805123 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writer thread running {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 21:12:15.119275 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: WARNING keystonemiddleware.auth_token [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 21:12:15.126697 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: WARNING keystonemiddleware.auth_token [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 21:12:15.135511 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: WARNING keystonemiddleware.auth_token [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 21:12:15.142767 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: WARNING keystonemiddleware.auth_token [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 21:12:15.478283 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: WARNING keystonemiddleware.auth_token [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 21:12:15.484487 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: WARNING keystonemiddleware.auth_token [None req-7b7f65e3-cbb1-48b0-a3a1-c0f04643d964 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 21:12:15.489810 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b36bc1f9c0 pid: 117737 (default app) Jun 16 21:12:15.495658 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: WARNING keystonemiddleware.auth_token [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 21:12:15.501610 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: WARNING keystonemiddleware.auth_token [None req-6aa1d944-15d2-49fe-a0e3-8f88bd6d90ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 21:12:15.506921 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b36bc1f9c0 pid: 117738 (default app) Jun 16 21:12:55.183273 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=3 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:55.184949 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=3 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:55.186083 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=3 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:55.187149 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=3 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:56.037673 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=3 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:56.039003 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=3 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:56.039728 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=3 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:56.040540 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=3 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:56.689867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ad6632a5-b941-462e-a76b-c16ed882afe8 tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] Action: 'create', calling method: .version_select at 0x7fb3fd737790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-619318473", "metadata": {"Type": "work"}}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:12:56.710240 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-171b5eb9-f507-4186-9a89-78c810fe5e0c tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Action: 'create', calling method: .version_select at 0x7fb3fd737790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1332148851"}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:12:58.037691 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ad6632a5-b941-462e-a76b-c16ed882afe8 tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.870922 Jun 16 21:12:58.039840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1155 bytes} [Thu Jun 16 21:12:55 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2874 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 21:12:58.045699 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-171b5eb9-f507-4186-9a89-78c810fe5e0c tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.013702 Jun 16 21:12:58.053661 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 1/2] 10.222.0.43 () {60 vars in 1154 bytes} [Thu Jun 16 21:12:56 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2023 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 16 21:12:58.068555 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-901388c3-390b-4b58-8b50-edfed0212828 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Calling method '.version_select at 0x7fb3fd6005e0>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:12:58.070245 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e53dbc16-6d4e-49a1-9e9d-4a63706ab25c tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] Calling method '.version_select at 0x7fb3fd602670>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:12:58.143870 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-901388c3-390b-4b58-8b50-edfed0212828 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f" status: 200 len: 345 microversion: 2.1 time: 0.086704 Jun 16 21:12:58.154095 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:12:58 2022] GET /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f => generated 345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:12:58.202800 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e53dbc16-6d4e-49a1-9e9d-4a63706ab25c tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4" status: 200 len: 352 microversion: 2.1 time: 0.144824 Jun 16 21:12:58.205897 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:12:58 2022] GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4 => generated 352 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:12:59.074880 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3f3d9607-b205-4525-ac9f-e766d25c3eb3 tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] Calling method '.version_select at 0x7fb3fd600700>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:12:59.156396 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-3f3d9607-b205-4525-ac9f-e766d25c3eb3 tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/e44e1f79-0b05-468a-aac1-bd0108984dd3" status: 200 len: 351 microversion: 2.1 time: 0.086609 Jun 16 21:12:59.157489 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 3/5] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:12:59 2022] GET /compute/v2.1/os-volumes/e44e1f79-0b05-468a-aac1-bd0108984dd3 => generated 351 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:12:59.157605 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c5b9709b-1f87-403e-ad87-ed2c57e7a615 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Calling method '.version_select at 0x7fb3fd6029d0>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:12:59.218921 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-ff19fb04-2e95-4182-9ce3-7f23f105a0a6 tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] Calling method '.version_select at 0x7fb3fd600dc0>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:12:59.265176 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c5b9709b-1f87-403e-ad87-ed2c57e7a615 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f" status: 200 len: 346 microversion: 2.1 time: 0.111278 Jun 16 21:12:59.265820 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 3/6] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:12:59 2022] GET /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f => generated 346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:12:59.277180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-3edf2eba-c90e-4852-864f-44d53af18233 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Action: 'create', calling method: .version_select at 0x7fb3fd602dc0>, body: {"snapshot": {"volume_id": "807703e7-bd84-4739-81be-3e2797130a6f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1678548507"}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:12:59.429880 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-ff19fb04-2e95-4182-9ce3-7f23f105a0a6 tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4" status: 200 len: 353 microversion: 2.1 time: 0.215449 Jun 16 21:12:59.431521 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:12:59 2022] GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4 => generated 353 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:12:59.442865 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-612997d3-c656-4088-85b0-a3b0218949cc tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] Calling method '.version_select at 0x7fb3fd613550>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:12:59.814403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-612997d3-c656-4088-85b0-a3b0218949cc tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4" status: 200 len: 353 microversion: 2.1 time: 0.375541 Jun 16 21:12:59.815625 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 5/8] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:12:59 2022] GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4 => generated 353 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:12:59.836068 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-931f04a2-56cb-4aae-886a-588d425cc981 tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] Calling method '.version_select at 0x7fb3fd600d30>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:12:59.897551 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-3edf2eba-c90e-4852-864f-44d53af18233 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.624388 Jun 16 21:12:59.898297 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 4/9] 10.222.0.43 () {60 vars in 1161 bytes} [Thu Jun 16 21:12:59 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:12:59.908201 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-16f9c15c-ab7d-49bd-904e-85b82115a14d tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Calling method '.version_select at 0x7fb3fd61aa60>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:00.028755 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-931f04a2-56cb-4aae-886a-588d425cc981 tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4" status: 202 len: 0 microversion: 2.1 time: 0.196359 Jun 16 21:13:00.029325 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 6/10] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 16 21:12:59 2022] DELETE /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 21:13:00.040776 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-ee0a45e3-7e15-4f12-ae63-7ae391156621 tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] Calling method '.version_select at 0x7fb3fd6008b0>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:00.114403 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-16f9c15c-ab7d-49bd-904e-85b82115a14d tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0" status: 200 len: 287 microversion: 2.1 time: 0.209918 Jun 16 21:13:00.123239 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 5/11] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 16 21:12:59 2022] GET /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0 => generated 287 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:00.130544 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f4e80323-dbb7-41c3-abde-57e9754b2b0b tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Calling method '.version_select at 0x7fb3fd602d30>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:00.145541 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-ee0a45e3-7e15-4f12-ae63-7ae391156621 tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4" status: 200 len: 352 microversion: 2.1 time: 0.109458 Jun 16 21:13:00.146938 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 7/12] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:13:00 2022] GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4 => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:13:00.190996 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f4e80323-dbb7-41c3-abde-57e9754b2b0b tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.065726 Jun 16 21:13:00.192541 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 6/13] 10.222.0.43 () {58 vars in 1139 bytes} [Thu Jun 16 21:13:00 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:00.203968 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-524d161e-1709-4d22-895c-e38bf9d24520 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Calling method '.version_select at 0x7fb3fd613700>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:00.245455 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-524d161e-1709-4d22-895c-e38bf9d24520 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0" status: 200 len: 287 microversion: 2.1 time: 0.045726 Jun 16 21:13:00.248720 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 8/14] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 16 21:13:00 2022] GET /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:13:01.159885 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-54b69bea-3fb4-486a-a26b-3747b84ff615 tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] Calling method '.version_select at 0x7fb3fd61a940>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:01.216528 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-54b69bea-3fb4-486a-a26b-3747b84ff615 tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4" status: 200 len: 352 microversion: 2.1 time: 0.062013 Jun 16 21:13:01.217783 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 7/15] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:13:01 2022] GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:01.260472 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-071c66d5-ebb2-45dd-896e-326f9942c721 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Calling method '.version_select at 0x7fb3fd600700>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:01.301758 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-071c66d5-ebb2-45dd-896e-326f9942c721 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0" status: 200 len: 287 microversion: 2.1 time: 0.045606 Jun 16 21:13:01.303243 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 9/16] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 16 21:13:01 2022] GET /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:02.229547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b2e0dc7e-afea-4893-83d3-aa8837e3de6c tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] Calling method '.version_select at 0x7fb3fd61a1f0>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:02.315518 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4e2be031-9a69-4aaa-ba0f-59ca990c410b tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Calling method '.version_select at 0x7fb3fd600dc0>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:02.369927 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b2e0dc7e-afea-4893-83d3-aa8837e3de6c tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4" status: 200 len: 352 microversion: 2.1 time: 0.144810 Jun 16 21:13:02.371036 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 8/17] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:13:02 2022] GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4 => generated 352 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:02.465172 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4e2be031-9a69-4aaa-ba0f-59ca990c410b tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0" status: 200 len: 287 microversion: 2.1 time: 0.154134 Jun 16 21:13:02.466334 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 10/18] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 16 21:13:02 2022] GET /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0 => generated 287 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:03.393483 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9864b807-53b5-4585-bcaf-bd47bece055b tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] Calling method '.version_select at 0x7fb3fd61a3a0>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:03.482942 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5591d639-859f-4e77-9c85-31f6b796ff6b tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Calling method '.version_select at 0x7fb3fd613790>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:03.526722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9864b807-53b5-4585-bcaf-bd47bece055b tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4" status: 200 len: 352 microversion: 2.1 time: 0.147437 Jun 16 21:13:03.527991 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 9/19] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:13:03 2022] GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4 => generated 352 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:03.579199 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5591d639-859f-4e77-9c85-31f6b796ff6b tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0" status: 200 len: 288 microversion: 2.1 time: 0.106139 Jun 16 21:13:03.581101 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 11/20] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 16 21:13:03 2022] GET /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0 => generated 288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:13:03.596969 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9e8a0a79-8295-48a5-9326-883b00907e46 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Calling method '.version_select at 0x7fb3fd61ac10>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:03.776782 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9e8a0a79-8295-48a5-9326-883b00907e46 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0" status: 202 len: 0 microversion: 2.1 time: 0.189401 Jun 16 21:13:03.777763 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 10/21] 10.222.0.43 () {58 vars in 1253 bytes} [Thu Jun 16 21:13:03 2022] DELETE /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:13:03.786641 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9c816150-fb3d-42cd-9936-e87fef4d368f tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Calling method '.version_select at 0x7fb3fd613dc0>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:03.855446 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-9c816150-fb3d-42cd-9936-e87fef4d368f tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0" status: 200 len: 287 microversion: 2.1 time: 0.072181 Jun 16 21:13:03.856655 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 12/22] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 16 21:13:03 2022] GET /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:04.411202 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ff5dd7a6-6050-4d18-b670-0d52c0e3f7fe tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] Calling method '.version_select at 0x7fb3fd602af0>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:04.521462 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ff5dd7a6-6050-4d18-b670-0d52c0e3f7fe tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ed541bbb-a347-4936-981b-aad26c282129" status: 200 len: 350 microversion: 2.1 time: 0.114026 Jun 16 21:13:04.523756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:13:04 2022] GET /compute/v2.1/os-volumes/ed541bbb-a347-4936-981b-aad26c282129 => generated 350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:04.541467 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1c97fb70-46ae-4826-9206-92d2b2b684a3 tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] Calling method '.version_select at 0x7fb3fd613b80>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:04.595409 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-1c97fb70-46ae-4826-9206-92d2b2b684a3 tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] HTTP exception thrown: Volume c44af651-a0ad-412f-a2b3-d81032f179a4 could not be found. Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1c97fb70-46ae-4826-9206-92d2b2b684a3 tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] Request method failure captured: Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4 HTTP/1.1 Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq5zX2Jhcbsbg7kZ9LuagEvztUW0got5Ep3o2hi_kZtxQGN2n8lwYFp9YYiXWAQPM76tBN2lMsx4SU5k1igwU79UHQXvQhbQfMYlT_aFVNu1HyJ2dIT-fnRw5O8gEI7ldaJfLwun9FVfy80KZwdTqjgui7rlVQnCOIHGfhjBvacK7Jdw Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: fdc119fbe54e4bbfa0e0c791d70a1275 Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-VolumesGetTestJSON-1622641178 Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:13:04.601059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:13:04.602117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fdc119fbe54e4bbfa0e0c791d70a1275"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fdc119fbe54e4bbfa0e0c791d70a1275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fdc119fbe54e4bbfa0e0c791d70a1275"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fdc119fbe54e4bbfa0e0c791d70a1275"}]}] Jun 16 21:13:04.602117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-VolumesGetTestJSON-1622641178 Jun 16 21:13:04.602117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: fdc119fbe54e4bbfa0e0c791d70a1275 Jun 16 21:13:04.602117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-VolumesGetTestJSON-1622641178 Jun 16 21:13:04.602117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-VolumesGetTestJSON-1622641178-project Jun 16 21:13:04.602117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:13:04.602117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:13:04.602117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: dfbaaf40d04d4853af55973301b68d65 Jun 16 21:13:04.602117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-VolumesGetTestJSON-1622641178-project Jun 16 21:13:04.602117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: Jun 16 21:13:04.602117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Volume c44af651-a0ad-412f-a2b3-d81032f179a4 could not be found. Jun 16 21:13:04.602117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': 'c44af651-a0ad-412f-a2b3-d81032f179a4'} Jun 16 21:13:04.602117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c44af651-a0ad-412f-a2b3-d81032f179a4 could not be found. (HTTP 404) (Request-ID: req-3abf8af0-35dd-49d7-a80e-c3c19d38b907) Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:13:04.602792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 21:13:04.603626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c44af651-a0ad-412f-a2b3-d81032f179a4 could not be found. Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 21:13:04.606902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:13:04.608269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c44af651-a0ad-412f-a2b3-d81032f179a4 could not be found. Jun 16 21:13:04.608269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:13:04.608269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:13:04.608269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:13:04.608269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:04.608269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:13:04.608269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:13:04.608269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:13:04.608269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:13:04.608269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c44af651-a0ad-412f-a2b3-d81032f179a4 could not be found. Jun 16 21:13:04.608269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:13:04.612349 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1c97fb70-46ae-4826-9206-92d2b2b684a3 tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] Returning 404 to user: Volume c44af651-a0ad-412f-a2b3-d81032f179a4 could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:13:04.613407 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1c97fb70-46ae-4826-9206-92d2b2b684a3 tempest-VolumesGetTestJSON-1622641178 tempest-VolumesGetTestJSON-1622641178-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4" status: 404 len: 109 microversion: 2.1 time: 0.078374 Jun 16 21:13:04.614165 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 13/24] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:13:04 2022] GET /compute/v2.1/os-volumes/c44af651-a0ad-412f-a2b3-d81032f179a4 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:13:04.867164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-af1f98b3-f95c-4130-825b-6f6c5a52a764 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Calling method '.version_select at 0x7fb3fd602ca0>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:04.925440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-af1f98b3-f95c-4130-825b-6f6c5a52a764 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] HTTP exception thrown: Snapshot 702ae666-27fa-4ce3-9ea2-31017abbb2c0 could not be found. Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-af1f98b3-f95c-4130-825b-6f6c5a52a764 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Request method failure captured: Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: GET /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0 HTTP/1.1 Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5zXKQ1bKSd7EKiizFIJcZxtKGPUXZUbH9FWfkDmRufI2DSS9JaYyP7Ie5ueyWVu5eE_a-ZnjRbCYtCs1al0LCYDxp70ByaAiQTqnnlQCpP_Ncajtn05Ov8U-C7hbkV4Dc70KQfEgqOouawrzUwrnzGUDQ72hOiztmk4OjLR3L4vyQk Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 132f4f9e80f54d40a439a40fd74ff3a7 Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-125318698 Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:13:04.931451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:13:04.932630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/132f4f9e80f54d40a439a40fd74ff3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_132f4f9e80f54d40a439a40fd74ff3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/132f4f9e80f54d40a439a40fd74ff3a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/132f4f9e80f54d40a439a40fd74ff3a7"}]}] Jun 16 21:13:04.932630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-VolumesSnapshotsTestJSON-125318698 Jun 16 21:13:04.932630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 132f4f9e80f54d40a439a40fd74ff3a7 Jun 16 21:13:04.932630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-125318698 Jun 16 21:13:04.932630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-VolumesSnapshotsTestJSON-125318698-project Jun 16 21:13:04.932630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:13:04.932630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:13:04.932630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: fea40c33d3564ec1883e2ee441808b60 Jun 16 21:13:04.932630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-VolumesSnapshotsTestJSON-125318698-project Jun 16 21:13:04.932630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: Jun 16 21:13:04.932630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Snapshot 702ae666-27fa-4ce3-9ea2-31017abbb2c0 could not be found. Jun 16 21:13:04.932630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '702ae666-27fa-4ce3-9ea2-31017abbb2c0'} Jun 16 21:13:04.932630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 702ae666-27fa-4ce3-9ea2-31017abbb2c0 could not be found. (HTTP 404) (Request-ID: req-1f291344-c411-48b6-a9c2-4d14774ba450) Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:04.933240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 21:13:04.934042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 702ae666-27fa-4ce3-9ea2-31017abbb2c0 could not be found. Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 21:13:04.934883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:13:04.935793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 702ae666-27fa-4ce3-9ea2-31017abbb2c0 could not be found. Jun 16 21:13:04.935793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:04.935793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:13:04.935793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:04.935793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:04.935793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:13:04.935793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:13:04.935793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:13:04.935793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:13:04.935793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 702ae666-27fa-4ce3-9ea2-31017abbb2c0 could not be found. Jun 16 21:13:04.935793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:04.941092 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-af1f98b3-f95c-4130-825b-6f6c5a52a764 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Returning 404 to user: Snapshot 702ae666-27fa-4ce3-9ea2-31017abbb2c0 could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:13:04.942251 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-af1f98b3-f95c-4130-825b-6f6c5a52a764 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0" status: 404 len: 111 microversion: 2.1 time: 0.079330 Jun 16 21:13:04.946006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 12/25] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 16 21:13:04 2022] GET /compute/v2.1/os-snapshots/702ae666-27fa-4ce3-9ea2-31017abbb2c0 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:13:04.955767 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0de634ac-e674-4d26-b6e9-16935963bc60 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Calling method '.version_select at 0x7fb3fdfe6af0>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:05.141651 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0de634ac-e674-4d26-b6e9-16935963bc60 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f" status: 202 len: 0 microversion: 2.1 time: 0.190915 Jun 16 21:13:05.142820 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 14/26] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 16 21:13:04 2022] DELETE /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:13:05.154140 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f8c5e67b-f928-45b6-b343-149abe5fa608 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Calling method '.version_select at 0x7fb3fd5870d0>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:05.310991 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f8c5e67b-f928-45b6-b343-149abe5fa608 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f" status: 200 len: 345 microversion: 2.1 time: 0.163669 Jun 16 21:13:05.312676 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 13/27] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:13:05 2022] GET /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f => generated 345 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:06.323911 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-61ded8ab-4aa7-4cca-adb2-4b5e9a288540 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Calling method '.version_select at 0x7fb3fd5811f0>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:06.384439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-61ded8ab-4aa7-4cca-adb2-4b5e9a288540 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] HTTP exception thrown: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-61ded8ab-4aa7-4cca-adb2-4b5e9a288540 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Request method failure captured: Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f HTTP/1.1 Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq5zXKQ1bKSd7EKiizFIJcZxtKGPUXZUbH9FWfkDmRufI2DSS9JaYyP7Ie5ueyWVu5eE_a-ZnjRbCYtCs1al0LCYDxp70ByaAiQTqnnlQCpP_Ncajtn05Ov8U-C7hbkV4Dc70KQfEgqOouawrzUwrnzGUDQ72hOiztmk4OjLR3L4vyQk Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 132f4f9e80f54d40a439a40fd74ff3a7 Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-125318698 Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:13:06.386464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:13:06.387671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/132f4f9e80f54d40a439a40fd74ff3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_132f4f9e80f54d40a439a40fd74ff3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/132f4f9e80f54d40a439a40fd74ff3a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/132f4f9e80f54d40a439a40fd74ff3a7"}]}] Jun 16 21:13:06.387671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-VolumesSnapshotsTestJSON-125318698 Jun 16 21:13:06.387671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 132f4f9e80f54d40a439a40fd74ff3a7 Jun 16 21:13:06.387671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-125318698 Jun 16 21:13:06.387671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-VolumesSnapshotsTestJSON-125318698-project Jun 16 21:13:06.387671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:13:06.387671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:13:06.387671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: fea40c33d3564ec1883e2ee441808b60 Jun 16 21:13:06.387671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-VolumesSnapshotsTestJSON-125318698-project Jun 16 21:13:06.387671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: Jun 16 21:13:06.387671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. Jun 16 21:13:06.387671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '807703e7-bd84-4739-81be-3e2797130a6f'} Jun 16 21:13:06.387671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. (HTTP 404) (Request-ID: req-9692b489-898e-4879-b5b8-a087e0e349c8) Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:13:06.388374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 21:13:06.389368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 21:13:06.390304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:13:06.391310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. Jun 16 21:13:06.391310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.391310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:13:06.391310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.391310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:06.391310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:13:06.391310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:13:06.391310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:13:06.391310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:13:06.391310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. Jun 16 21:13:06.391310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.391310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-61ded8ab-4aa7-4cca-adb2-4b5e9a288540 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Returning 404 to user: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:13:06.391310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-61ded8ab-4aa7-4cca-adb2-4b5e9a288540 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f" status: 404 len: 109 microversion: 2.1 time: 0.067718 Jun 16 21:13:06.401250 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 15/28] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:13:06 2022] GET /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:13:06.409944 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b84f2e07-98d2-4c51-b525-1eafe38f096e tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Calling method '.version_select at 0x7fb3fd61aee0>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:06.435490 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-eb10566a-b9fd-4f7f-859f-e5fd1ce7efbf tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] Calling method '.version_select at 0x7fb3fd581ee0>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:06.511179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-b84f2e07-98d2-4c51-b525-1eafe38f096e tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] HTTP exception thrown: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b84f2e07-98d2-4c51-b525-1eafe38f096e tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Request method failure captured: Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: DELETE /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f HTTP/1.1 Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5zXKQ1bKSd7EKiizFIJcZxtKGPUXZUbH9FWfkDmRufI2DSS9JaYyP7Ie5ueyWVu5eE_a-ZnjRbCYtCs1al0LCYDxp70ByaAiQTqnnlQCpP_Ncajtn05Ov8U-C7hbkV4Dc70KQfEgqOouawrzUwrnzGUDQ72hOiztmk4OjLR3L4vyQk Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 132f4f9e80f54d40a439a40fd74ff3a7 Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-125318698 Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:13:06.514174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:13:06.515265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/132f4f9e80f54d40a439a40fd74ff3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_132f4f9e80f54d40a439a40fd74ff3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/132f4f9e80f54d40a439a40fd74ff3a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/132f4f9e80f54d40a439a40fd74ff3a7"}]}] Jun 16 21:13:06.515265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-VolumesSnapshotsTestJSON-125318698 Jun 16 21:13:06.515265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 132f4f9e80f54d40a439a40fd74ff3a7 Jun 16 21:13:06.515265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-125318698 Jun 16 21:13:06.515265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-VolumesSnapshotsTestJSON-125318698-project Jun 16 21:13:06.515265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:13:06.515265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:13:06.515265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: fea40c33d3564ec1883e2ee441808b60 Jun 16 21:13:06.515265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-VolumesSnapshotsTestJSON-125318698-project Jun 16 21:13:06.515265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: Jun 16 21:13:06.515265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. Jun 16 21:13:06.515265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '807703e7-bd84-4739-81be-3e2797130a6f'} Jun 16 21:13:06.515265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. (HTTP 404) (Request-ID: req-c8b37e38-bc9e-4e29-b135-2484f7a10af2) Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:13:06.515874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 21:13:06.522348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 21:13:06.523663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:13:06.526637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. Jun 16 21:13:06.526637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.526637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:13:06.526637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.526637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:06.526637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:13:06.526637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:13:06.526637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:13:06.526637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:13:06.526637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. Jun 16 21:13:06.526637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.526637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b84f2e07-98d2-4c51-b525-1eafe38f096e tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Returning 404 to user: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:13:06.526637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b84f2e07-98d2-4c51-b525-1eafe38f096e tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f" status: 404 len: 109 microversion: 2.1 time: 0.110574 Jun 16 21:13:06.526637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 14/29] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 16 21:13:06 2022] DELETE /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:13:06.529618 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-765b6656-3f08-4687-9f77-cc574f2cdd40 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Calling method '.version_select at 0x7fb3fd587940>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:06.575022 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-eb10566a-b9fd-4f7f-859f-e5fd1ce7efbf tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/bf167aac-3b1f-43a9-a07e-39c916d43026" status: 200 len: 350 microversion: 2.1 time: 0.147252 Jun 16 21:13:06.576322 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 16/30] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:13:06 2022] GET /compute/v2.1/os-volumes/bf167aac-3b1f-43a9-a07e-39c916d43026 => generated 350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:06.588398 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-555431da-dc23-40c8-97df-15f59d3196b8 tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] Calling method '.version_select at 0x7fb3fd581c10>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:06.593324 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-765b6656-3f08-4687-9f77-cc574f2cdd40 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] HTTP exception thrown: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-765b6656-3f08-4687-9f77-cc574f2cdd40 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Request method failure captured: Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: GET /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f HTTP/1.1 Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5zXKQ1bKSd7EKiizFIJcZxtKGPUXZUbH9FWfkDmRufI2DSS9JaYyP7Ie5ueyWVu5eE_a-ZnjRbCYtCs1al0LCYDxp70ByaAiQTqnnlQCpP_Ncajtn05Ov8U-C7hbkV4Dc70KQfEgqOouawrzUwrnzGUDQ72hOiztmk4OjLR3L4vyQk Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 132f4f9e80f54d40a439a40fd74ff3a7 Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-125318698 Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:13:06.596059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:13:06.597226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/132f4f9e80f54d40a439a40fd74ff3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_132f4f9e80f54d40a439a40fd74ff3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/132f4f9e80f54d40a439a40fd74ff3a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/132f4f9e80f54d40a439a40fd74ff3a7"}]}] Jun 16 21:13:06.597226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-VolumesSnapshotsTestJSON-125318698 Jun 16 21:13:06.597226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 132f4f9e80f54d40a439a40fd74ff3a7 Jun 16 21:13:06.597226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-125318698 Jun 16 21:13:06.597226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-VolumesSnapshotsTestJSON-125318698-project Jun 16 21:13:06.597226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:13:06.597226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:13:06.597226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: fea40c33d3564ec1883e2ee441808b60 Jun 16 21:13:06.597226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-VolumesSnapshotsTestJSON-125318698-project Jun 16 21:13:06.597226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: Jun 16 21:13:06.597226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. Jun 16 21:13:06.597226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '807703e7-bd84-4739-81be-3e2797130a6f'} Jun 16 21:13:06.597226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. (HTTP 404) (Request-ID: req-7e840f71-7d21-4fa6-aee7-bd60bdcb724f) Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:13:06.597845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 21:13:06.598838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 21:13:06.600703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:13:06.603370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. Jun 16 21:13:06.603370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.603370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:13:06.603370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.603370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:13:06.603370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:13:06.603370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:13:06.603370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:13:06.603370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:13:06.603370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. Jun 16 21:13:06.603370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:13:06.603370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-765b6656-3f08-4687-9f77-cc574f2cdd40 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] Returning 404 to user: Volume 807703e7-bd84-4739-81be-3e2797130a6f could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:13:06.603370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-765b6656-3f08-4687-9f77-cc574f2cdd40 tempest-VolumesSnapshotsTestJSON-125318698 tempest-VolumesSnapshotsTestJSON-125318698-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f" status: 404 len: 109 microversion: 2.1 time: 0.077870 Jun 16 21:13:06.606638 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 15/31] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:13:06 2022] GET /compute/v2.1/os-volumes/807703e7-bd84-4739-81be-3e2797130a6f => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 21:13:06.859592 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-555431da-dc23-40c8-97df-15f59d3196b8 tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.275008 Jun 16 21:13:06.860185 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 17/32] 10.222.0.43 () {58 vars in 1133 bytes} [Thu Jun 16 21:13:06 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:06.876604 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b49c9c39-c7ee-4e27-a8cf-158cc3821518 tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] Calling method '.version_select at 0x7fb3fd61a0d0>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:07.115592 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b49c9c39-c7ee-4e27-a8cf-158cc3821518 tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.245624 Jun 16 21:13:07.116158 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 16/33] 10.222.0.43 () {58 vars in 1148 bytes} [Thu Jun 16 21:13:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:07.129987 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a7a2c3ca-5fc9-4b7e-b4da-8a57a17a945a tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] Calling method '.version_select at 0x7fb3fd613c10>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:07.385406 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a7a2c3ca-5fc9-4b7e-b4da-8a57a17a945a tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.255203 Jun 16 21:13:07.386281 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 18/34] 10.222.0.43 () {58 vars in 1133 bytes} [Thu Jun 16 21:13:07 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:07.399849 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9f0e9afa-7aa3-4da8-b676-6c58500d94f9 tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] Calling method '.version_select at 0x7fb3fd587ee0>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:07.633573 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9f0e9afa-7aa3-4da8-b676-6c58500d94f9 tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.239563 Jun 16 21:13:07.640907 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 17/35] 10.222.0.43 () {58 vars in 1166 bytes} [Thu Jun 16 21:13:07 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:07.646479 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8f9a40ce-703f-4e5b-8d2e-393a730f00fa tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] Calling method '.version_select at 0x7fb3fd5891f0>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:07.862344 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8f9a40ce-703f-4e5b-8d2e-393a730f00fa tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.220258 Jun 16 21:13:07.863495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 19/36] 10.222.0.43 () {58 vars in 1169 bytes} [Thu Jun 16 21:13:07 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:07.879259 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-59d56116-efd8-4943-a047-670b64a0e8d6 tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] Calling method '.version_select at 0x7fb3fd5879d0>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:08.087017 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-59d56116-efd8-4943-a047-670b64a0e8d6 tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.212590 Jun 16 21:13:08.087597 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 18/37] 10.222.0.43 () {58 vars in 1154 bytes} [Thu Jun 16 21:13:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:08.100024 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-dd81f0c5-891d-4aaa-a138-e08cc9db0c94 tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] Calling method '.version_select at 0x7fb3fd581b80>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:08.326398 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-dd81f0c5-891d-4aaa-a138-e08cc9db0c94 tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.231141 Jun 16 21:13:08.327070 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 20/38] 10.222.0.43 () {58 vars in 1187 bytes} [Thu Jun 16 21:13:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:08.338929 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-33c1f76c-93d0-4b31-abb4-8b05101ad351 tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] Calling method '.version_select at 0x7fb3fd61a310>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:08.455760 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-33c1f76c-93d0-4b31-abb4-8b05101ad351 tempest-VolumesTestJSON-948729850 tempest-VolumesTestJSON-948729850-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.120924 Jun 16 21:13:08.461971 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 19/39] 10.222.0.43 () {58 vars in 1154 bytes} [Thu Jun 16 21:13:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:09.347851 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d3c544f8-58fa-4bf8-b188-8187c7454c36 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Action: 'create', calling method: .version_select at 0x7fb3fd581ee0>, body: {"keypair": {"name": "tempest-keypair-724510636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBES1jOPE7m1YhPUZa3F5L0ItXffwtx+9GgDpKinhM9ssv1MGMgWKeOVhYqbecWxnV6/jgGs5UJkEd7SmjINwdXAZFXvAf6pVfgNPHV8UlECob8If5XYnumWBJyuzVUNdoQ=="}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:13:09.560035 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-d3c544f8-58fa-4bf8-b188-8187c7454c36 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Getting quotas for project 8fd2e5ab99c341d38c3f78dc17c0faf2. Resources: {'key_pairs'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:13:09.581159 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-d3c544f8-58fa-4bf8-b188-8187c7454c36 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Getting quotas for user 8cc395fc4407473e9595bc99c6b6b36c and project 8fd2e5ab99c341d38c3f78dc17c0faf2. Resources: {'key_pairs'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:13:09.737935 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d3c544f8-58fa-4bf8-b188-8187c7454c36 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.655809 Jun 16 21:13:09.739052 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 21/40] 10.222.0.43 () {62 vars in 1199 bytes} [Thu Jun 16 21:13:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 658 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 21:13:12.473195 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e30c58cd-4f23-442a-b928-b3352a98f7ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Action: 'create', calling method: .version_select at 0x7fb3fd625280>, body: {"keypair": {"name": "tempest-keypair-332938601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1eOPP3qynlPKJUaRryazKsSpPkvUC4jiZKHGjOr+sXNjUCI5OVG1LuxDgcU7d6YkvZQgyQuVFJsxwG8MxoXTyOcXGzV3Tg+s/tcsISVumWj+rkEbB46x3gassOMJ3F/g=="}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:13:12.569896 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-e30c58cd-4f23-442a-b928-b3352a98f7ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Getting quotas for project f22cbeb1402848dbb84a5718dca357e1. Resources: {'key_pairs'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:13:12.616876 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-e30c58cd-4f23-442a-b928-b3352a98f7ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Getting quotas for user 2cb12a51b62c48ba95be62f167b7314e and project f22cbeb1402848dbb84a5718dca357e1. Resources: {'key_pairs'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:13:12.795652 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e30c58cd-4f23-442a-b928-b3352a98f7ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.928011 Jun 16 21:13:12.819038 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 16 21:13:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:15.138533 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-bda9f7bc-6917-4184-9a76-f5c0be5d4008 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-994227657", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452", "networks": [{"uuid": "84c78649-9aa8-4eb4-a6f2-165e9dc816ed"}]}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:13:15.331614 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.network.neutron [None req-bda9f7bc-6917-4184-9a76-f5c0be5d4008 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] validate_networks() for [('84c78649-9aa8-4eb4-a6f2-165e9dc816ed', None, None, None, None, None)] {{(pid=117738) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:13:17.352450 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-76b7cd49-b290-4e97-a4b6-557b991c4ba3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Action: 'create', calling method: .version_select at 0x7fb3fd5545e0>, body: {"keypair": {"name": "tempest-keypair-1322796889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAv1LzyZ4fPFGUHgdDz89UO2cPb2Z30bXMsc2zRxbsY3kFHRjqmsOxGVzVdWnMHqwchQZnL4HhUnrVbAdNWaQJOifXNZUK0M3W4fghtCLbuR49gl57QtsWe7I1UeXMtW1g=="}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:13:17.434785 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-76b7cd49-b290-4e97-a4b6-557b991c4ba3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Getting quotas for project 536b36bd517a4dca8706718f6bab9c1a. Resources: {'key_pairs'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:13:17.456106 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-76b7cd49-b290-4e97-a4b6-557b991c4ba3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Getting quotas for user 9c13ce02fca548c5b1186a536a2d4474 and project 536b36bd517a4dca8706718f6bab9c1a. Resources: {'key_pairs'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:13:17.544207 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-76b7cd49-b290-4e97-a4b6-557b991c4ba3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.914810 Jun 16 21:13:17.545240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 21/42] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 16 21:13:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:13:18.128929 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7c0b9ea6-cc0a-4c47-81c3-21649c65078e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-776547326", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f15db21b-4597-49e4-b0f9-2724f76cadbd"}], "security_groups": [{"name": "tempest-securitygroup--1104287588"}], "key_name": "tempest-keypair-724510636", "user_data": "}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:13:18.658383 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.network.neutron [None req-7c0b9ea6-cc0a-4c47-81c3-21649c65078e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] validate_networks() for [('f15db21b-4597-49e4-b0f9-2724f76cadbd', None, None, None, None, None)] {{(pid=117737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:13:19.222228 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-bda9f7bc-6917-4184-9a76-f5c0be5d4008 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Flavor limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:13:19.222760 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-bda9f7bc-6917-4184-9a76-f5c0be5d4008 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Image limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:13:19.223181 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-bda9f7bc-6917-4184-9a76-f5c0be5d4008 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Flavor pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:13:19.224028 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-bda9f7bc-6917-4184-9a76-f5c0be5d4008 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Image pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:13:19.224490 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-bda9f7bc-6917-4184-9a76-f5c0be5d4008 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:13:19.237388 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bda9f7bc-6917-4184-9a76-f5c0be5d4008 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:19.237837 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bda9f7bc-6917-4184-9a76-f5c0be5d4008 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:19.239618 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bda9f7bc-6917-4184-9a76-f5c0be5d4008 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:19.241325 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bda9f7bc-6917-4184-9a76-f5c0be5d4008 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:19.290866 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-bda9f7bc-6917-4184-9a76-f5c0be5d4008 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Getting quotas for project 87f4749861b548a6808e215ab16497d9. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:13:19.300260 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-bda9f7bc-6917-4184-9a76-f5c0be5d4008 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Getting quotas for user 26922cee7b794e0ca8cec43b6f5daff2 and project 87f4749861b548a6808e215ab16497d9. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:13:19.315589 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-bda9f7bc-6917-4184-9a76-f5c0be5d4008 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Going to run 1 instances... {{(pid=117738) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:13:19.318698 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-bda9f7bc-6917-4184-9a76-f5c0be5d4008 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:13:19.471631 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-bda9f7bc-6917-4184-9a76-f5c0be5d4008 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.795216 Jun 16 21:13:19.472333 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 22/43] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:13:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 4797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:13:19.484427 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1a79d505-7b49-454e-b237-57dbaa8733d2 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:19.487408 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1a79d505-7b49-454e-b237-57dbaa8733d2 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:19.693624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1a79d505-7b49-454e-b237-57dbaa8733d2 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:19.720782 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1a79d505-7b49-454e-b237-57dbaa8733d2 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1214 microversion: 2.1 time: 0.241566 Jun 16 21:13:19.733756 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 23/44] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:19 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1214 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:19.745017 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-473333ac-c674-4113-9e27-6c55da18b57e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2090856930", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4d0a869-8cad-4582-83ab-86c097e04c69"}], "security_groups": [{"name": "tempest-securitygroup--1213452077"}], "key_name": "tempest-keypair-332938601", "user_data": "}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:13:20.206649 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.network.neutron [None req-473333ac-c674-4113-9e27-6c55da18b57e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] validate_networks() for [('c4d0a869-8cad-4582-83ab-86c097e04c69', None, None, None, None, None)] {{(pid=117738) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:13:21.588000 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-473333ac-c674-4113-9e27-6c55da18b57e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Flavor limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:13:21.590337 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-473333ac-c674-4113-9e27-6c55da18b57e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Image limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:13:21.609452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-473333ac-c674-4113-9e27-6c55da18b57e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Flavor pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:13:21.610034 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-473333ac-c674-4113-9e27-6c55da18b57e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Image pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:13:21.610802 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-473333ac-c674-4113-9e27-6c55da18b57e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:13:21.632354 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-473333ac-c674-4113-9e27-6c55da18b57e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:21.636137 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-473333ac-c674-4113-9e27-6c55da18b57e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:21.640313 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-473333ac-c674-4113-9e27-6c55da18b57e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:21.641918 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-473333ac-c674-4113-9e27-6c55da18b57e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:21.704867 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-473333ac-c674-4113-9e27-6c55da18b57e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Getting quotas for project f22cbeb1402848dbb84a5718dca357e1. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:13:21.719174 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-473333ac-c674-4113-9e27-6c55da18b57e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Getting quotas for user 2cb12a51b62c48ba95be62f167b7314e and project f22cbeb1402848dbb84a5718dca357e1. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:13:21.753574 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-473333ac-c674-4113-9e27-6c55da18b57e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Going to run 1 instances... {{(pid=117738) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:13:21.762467 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-473333ac-c674-4113-9e27-6c55da18b57e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:13:21.971648 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-473333ac-c674-4113-9e27-6c55da18b57e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.236219 Jun 16 21:13:21.973361 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 24/45] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:13:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 2239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:13:22.007012 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-24a7f777-06fc-4011-85fd-93d4f58b2d7d tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:22.007936 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-24a7f777-06fc-4011-85fd-93d4f58b2d7d tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:22.041365 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-24a7f777-06fc-4011-85fd-93d4f58b2d7d tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:22.042801 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-24a7f777-06fc-4011-85fd-93d4f58b2d7d tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:22.044121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-24a7f777-06fc-4011-85fd-93d4f58b2d7d tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:22.045966 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-24a7f777-06fc-4011-85fd-93d4f58b2d7d tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:22.520494 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-7c0b9ea6-cc0a-4c47-81c3-21649c65078e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Flavor limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:13:22.521478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-7c0b9ea6-cc0a-4c47-81c3-21649c65078e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Image limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:13:22.522108 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-7c0b9ea6-cc0a-4c47-81c3-21649c65078e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Flavor pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:13:22.522739 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-7c0b9ea6-cc0a-4c47-81c3-21649c65078e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Image pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:13:22.523422 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-7c0b9ea6-cc0a-4c47-81c3-21649c65078e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:13:22.532616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-24a7f777-06fc-4011-85fd-93d4f58b2d7d tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:22.546696 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7c0b9ea6-cc0a-4c47-81c3-21649c65078e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:22.547162 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7c0b9ea6-cc0a-4c47-81c3-21649c65078e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:22.547995 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7c0b9ea6-cc0a-4c47-81c3-21649c65078e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:22.548473 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7c0b9ea6-cc0a-4c47-81c3-21649c65078e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:22.566747 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-24a7f777-06fc-4011-85fd-93d4f58b2d7d tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1218 microversion: 2.1 time: 0.590830 Jun 16 21:13:22.568789 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 25/46] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:21 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1218 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:22.586072 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-44cdd2f5-4bfb-4dea-82f4-3977e315bd1d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:22.587080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-44cdd2f5-4bfb-4dea-82f4-3977e315bd1d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:22.635619 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-7c0b9ea6-cc0a-4c47-81c3-21649c65078e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Getting quotas for project 8fd2e5ab99c341d38c3f78dc17c0faf2. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:13:22.647889 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-7c0b9ea6-cc0a-4c47-81c3-21649c65078e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Getting quotas for user 8cc395fc4407473e9595bc99c6b6b36c and project 8fd2e5ab99c341d38c3f78dc17c0faf2. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:13:22.688934 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7c0b9ea6-cc0a-4c47-81c3-21649c65078e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Going to run 1 instances... {{(pid=117737) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:13:22.691753 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7c0b9ea6-cc0a-4c47-81c3-21649c65078e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:13:22.941650 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7c0b9ea6-cc0a-4c47-81c3-21649c65078e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.818468 Jun 16 21:13:22.942850 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 22/47] 10.222.0.43 () {62 vars in 1187 bytes} [Thu Jun 16 21:13:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 4820 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 21:13:22.969187 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-97653d9b-eec6-42a6-a8d3-e75c5114fc60 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:22.969817 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-97653d9b-eec6-42a6-a8d3-e75c5114fc60 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:23.077420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-44cdd2f5-4bfb-4dea-82f4-3977e315bd1d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:23.096822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-44cdd2f5-4bfb-4dea-82f4-3977e315bd1d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1241 microversion: 2.1 time: 0.522431 Jun 16 21:13:23.099903 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 26/48] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:22 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1241 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:23.187446 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3711595a-d426-485d-a61a-cd70961b8bed tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-998431670", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c45b6299-9716-4173-aacf-27f0517667e5"}], "security_groups": [{"name": "tempest-securitygroup--1285371743"}], "key_name": "tempest-keypair-1322796889", "user_data": "}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:13:23.362624 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-97653d9b-eec6-42a6-a8d3-e75c5114fc60 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:23.407420 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-97653d9b-eec6-42a6-a8d3-e75c5114fc60 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:23.417298 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-97653d9b-eec6-42a6-a8d3-e75c5114fc60 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:23.424229 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-97653d9b-eec6-42a6-a8d3-e75c5114fc60 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1280 microversion: 2.20 time: 0.470240 Jun 16 21:13:23.426767 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 23/49] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:22 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1280 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:13:23.458562 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.network.neutron [None req-3711595a-d426-485d-a61a-cd70961b8bed tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] validate_networks() for [('c45b6299-9716-4173-aacf-27f0517667e5', None, None, None, None, None)] {{(pid=117738) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:13:23.588148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a3871f7c-3e2c-48af-b318-ae5efcd3ab8e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:23.588820 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a3871f7c-3e2c-48af-b318-ae5efcd3ab8e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:23.614814 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a3871f7c-3e2c-48af-b318-ae5efcd3ab8e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:23.615532 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a3871f7c-3e2c-48af-b318-ae5efcd3ab8e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:23.620110 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a3871f7c-3e2c-48af-b318-ae5efcd3ab8e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:23.620800 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a3871f7c-3e2c-48af-b318-ae5efcd3ab8e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:24.173770 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a3871f7c-3e2c-48af-b318-ae5efcd3ab8e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:24.205954 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a3871f7c-3e2c-48af-b318-ae5efcd3ab8e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1272 microversion: 2.1 time: 0.622221 Jun 16 21:13:24.208567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 24/50] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:23 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1272 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:24.215127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1c4e4e73-7729-4bb2-9379-ebef94b10ca6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:24.218352 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1c4e4e73-7729-4bb2-9379-ebef94b10ca6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:24.242143 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1c4e4e73-7729-4bb2-9379-ebef94b10ca6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:24.247960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1c4e4e73-7729-4bb2-9379-ebef94b10ca6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:24.249085 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1c4e4e73-7729-4bb2-9379-ebef94b10ca6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:24.249696 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1c4e4e73-7729-4bb2-9379-ebef94b10ca6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:24.368935 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1c4e4e73-7729-4bb2-9379-ebef94b10ca6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:24.378708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1c4e4e73-7729-4bb2-9379-ebef94b10ca6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1245 microversion: 2.1 time: 0.168807 Jun 16 21:13:24.379705 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 25/51] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:24 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1245 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:24.444652 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c3d7e634-df74-45ec-89c2-d1798f40a6ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:24.450240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c3d7e634-df74-45ec-89c2-d1798f40a6ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:24.461669 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c3d7e634-df74-45ec-89c2-d1798f40a6ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:24.466993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c3d7e634-df74-45ec-89c2-d1798f40a6ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:24.468329 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c3d7e634-df74-45ec-89c2-d1798f40a6ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:24.468914 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c3d7e634-df74-45ec-89c2-d1798f40a6ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:24.573558 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c3d7e634-df74-45ec-89c2-d1798f40a6ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:24.584751 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c3d7e634-df74-45ec-89c2-d1798f40a6ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:24.587213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c3d7e634-df74-45ec-89c2-d1798f40a6ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:24.589883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c3d7e634-df74-45ec-89c2-d1798f40a6ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1284 microversion: 2.20 time: 0.150656 Jun 16 21:13:24.605717 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 26/52] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:24 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:13:24.787202 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-3711595a-d426-485d-a61a-cd70961b8bed tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Flavor limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:13:24.787822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-3711595a-d426-485d-a61a-cd70961b8bed tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Image limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:13:24.789350 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-3711595a-d426-485d-a61a-cd70961b8bed tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Flavor pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:13:24.789935 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-3711595a-d426-485d-a61a-cd70961b8bed tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Image pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:13:24.790658 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-3711595a-d426-485d-a61a-cd70961b8bed tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:13:24.803951 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3711595a-d426-485d-a61a-cd70961b8bed tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:24.804583 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3711595a-d426-485d-a61a-cd70961b8bed tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:24.805599 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3711595a-d426-485d-a61a-cd70961b8bed tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:24.806345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3711595a-d426-485d-a61a-cd70961b8bed tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:24.844799 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-3711595a-d426-485d-a61a-cd70961b8bed tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Getting quotas for project 536b36bd517a4dca8706718f6bab9c1a. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:13:24.852103 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-3711595a-d426-485d-a61a-cd70961b8bed tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Getting quotas for user 9c13ce02fca548c5b1186a536a2d4474 and project 536b36bd517a4dca8706718f6bab9c1a. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:13:24.872634 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-3711595a-d426-485d-a61a-cd70961b8bed tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Going to run 1 instances... {{(pid=117738) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:13:24.874115 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-3711595a-d426-485d-a61a-cd70961b8bed tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:13:24.963919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-3711595a-d426-485d-a61a-cd70961b8bed tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.779377 Jun 16 21:13:24.965172 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 27/53] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:13:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:13:24.976594 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-772e2b21-8ec3-48c6-a0b2-0ea6575af916 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:24.977546 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-772e2b21-8ec3-48c6-a0b2-0ea6575af916 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:25.127295 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-772e2b21-8ec3-48c6-a0b2-0ea6575af916 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:25.134669 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-772e2b21-8ec3-48c6-a0b2-0ea6575af916 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1237 microversion: 2.1 time: 0.163188 Jun 16 21:13:25.137916 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 27/54] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:24 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1237 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:25.226393 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-454a8f31-613f-400e-8cb0-b89782ffdd2e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:25.227041 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-454a8f31-613f-400e-8cb0-b89782ffdd2e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:25.246837 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-454a8f31-613f-400e-8cb0-b89782ffdd2e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:25.247287 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-454a8f31-613f-400e-8cb0-b89782ffdd2e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:25.248056 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-454a8f31-613f-400e-8cb0-b89782ffdd2e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:25.248514 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-454a8f31-613f-400e-8cb0-b89782ffdd2e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:25.396685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8504b98e-0a44-4112-b83a-0b487f6b8e5e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:25.397475 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8504b98e-0a44-4112-b83a-0b487f6b8e5e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:25.408594 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-454a8f31-613f-400e-8cb0-b89782ffdd2e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:25.408779 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8504b98e-0a44-4112-b83a-0b487f6b8e5e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:25.409071 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8504b98e-0a44-4112-b83a-0b487f6b8e5e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:25.410045 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8504b98e-0a44-4112-b83a-0b487f6b8e5e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:25.411190 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8504b98e-0a44-4112-b83a-0b487f6b8e5e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:25.419375 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-454a8f31-613f-400e-8cb0-b89782ffdd2e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1272 microversion: 2.1 time: 0.196840 Jun 16 21:13:25.435842 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 28/55] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:25 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1272 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:25.599789 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8504b98e-0a44-4112-b83a-0b487f6b8e5e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:25.630727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a8d3c25b-e68c-4beb-807a-1c8a7cd3b538 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:25.631555 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a8d3c25b-e68c-4beb-807a-1c8a7cd3b538 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:25.638507 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8504b98e-0a44-4112-b83a-0b487f6b8e5e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1245 microversion: 2.1 time: 0.246536 Jun 16 21:13:25.641591 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 28/56] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:25 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1245 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:25.642591 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a8d3c25b-e68c-4beb-807a-1c8a7cd3b538 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:25.643253 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a8d3c25b-e68c-4beb-807a-1c8a7cd3b538 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:25.644076 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a8d3c25b-e68c-4beb-807a-1c8a7cd3b538 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:25.644778 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a8d3c25b-e68c-4beb-807a-1c8a7cd3b538 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:25.758674 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a8d3c25b-e68c-4beb-807a-1c8a7cd3b538 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:25.771896 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a8d3c25b-e68c-4beb-807a-1c8a7cd3b538 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:25.774914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a8d3c25b-e68c-4beb-807a-1c8a7cd3b538 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:25.776771 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a8d3c25b-e68c-4beb-807a-1c8a7cd3b538 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1284 microversion: 2.20 time: 0.156833 Jun 16 21:13:25.777507 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 29/57] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:25 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:13:26.155580 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7bf01261-22b3-42c3-8698-c7d12d66c9d5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:26.156815 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7bf01261-22b3-42c3-8698-c7d12d66c9d5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:26.167608 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7bf01261-22b3-42c3-8698-c7d12d66c9d5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:26.168137 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7bf01261-22b3-42c3-8698-c7d12d66c9d5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:26.169072 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7bf01261-22b3-42c3-8698-c7d12d66c9d5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:26.169642 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7bf01261-22b3-42c3-8698-c7d12d66c9d5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:26.258105 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7bf01261-22b3-42c3-8698-c7d12d66c9d5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:26.267299 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7bf01261-22b3-42c3-8698-c7d12d66c9d5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1241 microversion: 2.1 time: 0.115421 Jun 16 21:13:26.268378 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 29/58] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:26 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:26.438441 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3fc224e3-7a62-494e-b3a7-40959159333c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:26.439689 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-3fc224e3-7a62-494e-b3a7-40959159333c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:26.448058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3fc224e3-7a62-494e-b3a7-40959159333c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:26.448839 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3fc224e3-7a62-494e-b3a7-40959159333c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:26.449882 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3fc224e3-7a62-494e-b3a7-40959159333c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:26.450643 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3fc224e3-7a62-494e-b3a7-40959159333c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:26.528258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-3fc224e3-7a62-494e-b3a7-40959159333c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:26.541045 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-3fc224e3-7a62-494e-b3a7-40959159333c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1272 microversion: 2.1 time: 0.106314 Jun 16 21:13:26.541572 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 30/59] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:26 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1272 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:26.658156 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-29f01b8e-a946-45a7-9c71-a7c377f3ee0d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:26.658943 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-29f01b8e-a946-45a7-9c71-a7c377f3ee0d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:26.672131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-29f01b8e-a946-45a7-9c71-a7c377f3ee0d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:26.675082 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-29f01b8e-a946-45a7-9c71-a7c377f3ee0d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:26.678292 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-29f01b8e-a946-45a7-9c71-a7c377f3ee0d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:26.679776 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-29f01b8e-a946-45a7-9c71-a7c377f3ee0d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:26.802841 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a6cf5716-79c8-4250-a664-fb3e8981492a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:26.803499 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a6cf5716-79c8-4250-a664-fb3e8981492a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:26.824822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a6cf5716-79c8-4250-a664-fb3e8981492a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:26.825516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a6cf5716-79c8-4250-a664-fb3e8981492a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:26.826564 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a6cf5716-79c8-4250-a664-fb3e8981492a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:26.827255 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a6cf5716-79c8-4250-a664-fb3e8981492a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:26.896626 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-29f01b8e-a946-45a7-9c71-a7c377f3ee0d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:26.913103 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-29f01b8e-a946-45a7-9c71-a7c377f3ee0d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1245 microversion: 2.1 time: 0.258857 Jun 16 21:13:26.918761 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 30/60] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:26 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1245 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:27.008696 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a6cf5716-79c8-4250-a664-fb3e8981492a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:27.026553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a6cf5716-79c8-4250-a664-fb3e8981492a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:27.026933 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a6cf5716-79c8-4250-a664-fb3e8981492a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:27.028238 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a6cf5716-79c8-4250-a664-fb3e8981492a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1284 microversion: 2.20 time: 0.236931 Jun 16 21:13:27.028676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 31/61] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:26 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1284 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:27.298365 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-cd6bf912-8646-45e3-a00b-d3ffb744d6d3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:27.300107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-cd6bf912-8646-45e3-a00b-d3ffb744d6d3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:27.309486 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cd6bf912-8646-45e3-a00b-d3ffb744d6d3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:27.310401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cd6bf912-8646-45e3-a00b-d3ffb744d6d3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:27.311788 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cd6bf912-8646-45e3-a00b-d3ffb744d6d3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:27.312248 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cd6bf912-8646-45e3-a00b-d3ffb744d6d3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:27.455270 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-cd6bf912-8646-45e3-a00b-d3ffb744d6d3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:27.468464 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-cd6bf912-8646-45e3-a00b-d3ffb744d6d3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1289 microversion: 2.1 time: 0.184875 Jun 16 21:13:27.469093 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 31/62] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:27 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1289 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:27.558976 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5755bdfe-e53b-4e77-90fd-b07bc1f7da86 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:27.559719 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5755bdfe-e53b-4e77-90fd-b07bc1f7da86 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:27.569551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5755bdfe-e53b-4e77-90fd-b07bc1f7da86 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:27.570308 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5755bdfe-e53b-4e77-90fd-b07bc1f7da86 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:27.570979 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5755bdfe-e53b-4e77-90fd-b07bc1f7da86 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:27.580081 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5755bdfe-e53b-4e77-90fd-b07bc1f7da86 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:27.760473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5755bdfe-e53b-4e77-90fd-b07bc1f7da86 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:27.774648 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5755bdfe-e53b-4e77-90fd-b07bc1f7da86 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1272 microversion: 2.1 time: 0.220880 Jun 16 21:13:27.786443 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 32/63] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:27 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:27.935866 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-cb992c4e-511f-400d-9b5f-8492557d9930 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:27.936620 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-cb992c4e-511f-400d-9b5f-8492557d9930 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:27.948753 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cb992c4e-511f-400d-9b5f-8492557d9930 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:27.949207 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cb992c4e-511f-400d-9b5f-8492557d9930 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:27.949992 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cb992c4e-511f-400d-9b5f-8492557d9930 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:27.950432 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cb992c4e-511f-400d-9b5f-8492557d9930 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:28.048774 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-98cd11bf-6754-4ae6-ae0a-44bc8e6982bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:28.049680 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-98cd11bf-6754-4ae6-ae0a-44bc8e6982bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:28.063949 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-98cd11bf-6754-4ae6-ae0a-44bc8e6982bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:28.066672 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-98cd11bf-6754-4ae6-ae0a-44bc8e6982bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:28.072494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-98cd11bf-6754-4ae6-ae0a-44bc8e6982bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:28.073793 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-98cd11bf-6754-4ae6-ae0a-44bc8e6982bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:28.244626 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-cb992c4e-511f-400d-9b5f-8492557d9930 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:28.255657 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-cb992c4e-511f-400d-9b5f-8492557d9930 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1293 microversion: 2.1 time: 0.323300 Jun 16 21:13:28.267012 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 32/64] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:27 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1293 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:28.395321 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-98cd11bf-6754-4ae6-ae0a-44bc8e6982bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:28.415063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-98cd11bf-6754-4ae6-ae0a-44bc8e6982bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:28.427660 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-98cd11bf-6754-4ae6-ae0a-44bc8e6982bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:28.429143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-98cd11bf-6754-4ae6-ae0a-44bc8e6982bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1340 microversion: 2.20 time: 0.387761 Jun 16 21:13:28.432453 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 33/65] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:28 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1340 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:13:28.489836 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0c0edadf-6e37-44b9-a190-9ef59daf697a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:28.490551 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0c0edadf-6e37-44b9-a190-9ef59daf697a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:28.510920 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0c0edadf-6e37-44b9-a190-9ef59daf697a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:28.511488 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0c0edadf-6e37-44b9-a190-9ef59daf697a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:28.512406 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0c0edadf-6e37-44b9-a190-9ef59daf697a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:28.512835 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0c0edadf-6e37-44b9-a190-9ef59daf697a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:28.719514 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0c0edadf-6e37-44b9-a190-9ef59daf697a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:28.730411 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0c0edadf-6e37-44b9-a190-9ef59daf697a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1297 microversion: 2.1 time: 0.247097 Jun 16 21:13:28.735539 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 33/66] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:28 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1297 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:28.798178 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-148c3326-d192-46aa-aec5-d423d06632bb tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:28.799379 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-148c3326-d192-46aa-aec5-d423d06632bb tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:28.810212 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-148c3326-d192-46aa-aec5-d423d06632bb tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:28.811518 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-148c3326-d192-46aa-aec5-d423d06632bb tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:28.816395 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-148c3326-d192-46aa-aec5-d423d06632bb tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:28.817293 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-148c3326-d192-46aa-aec5-d423d06632bb tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:29.275827 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-dd0ea81e-ece4-41c3-9de5-9d50476fc65d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:29.276654 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-dd0ea81e-ece4-41c3-9de5-9d50476fc65d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:29.305891 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dd0ea81e-ece4-41c3-9de5-9d50476fc65d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:29.306928 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dd0ea81e-ece4-41c3-9de5-9d50476fc65d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:29.314313 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dd0ea81e-ece4-41c3-9de5-9d50476fc65d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:29.314852 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dd0ea81e-ece4-41c3-9de5-9d50476fc65d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:29.525713 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-dd0ea81e-ece4-41c3-9de5-9d50476fc65d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:29.533924 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-dd0ea81e-ece4-41c3-9de5-9d50476fc65d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1311 microversion: 2.1 time: 0.263364 Jun 16 21:13:29.534521 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 34/67] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:29 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1311 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:29.561832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5cde7158-59cb-4374-bf9b-addaa01ed0cd tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:29.562463 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5cde7158-59cb-4374-bf9b-addaa01ed0cd tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:29.574718 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5cde7158-59cb-4374-bf9b-addaa01ed0cd tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:29.581349 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5cde7158-59cb-4374-bf9b-addaa01ed0cd tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:29.582790 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5cde7158-59cb-4374-bf9b-addaa01ed0cd tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:29.583246 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5cde7158-59cb-4374-bf9b-addaa01ed0cd tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:29.730517 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5cde7158-59cb-4374-bf9b-addaa01ed0cd tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:29.748281 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5cde7158-59cb-4374-bf9b-addaa01ed0cd tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:29.751503 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5cde7158-59cb-4374-bf9b-addaa01ed0cd tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:29.759713 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5cde7158-59cb-4374-bf9b-addaa01ed0cd tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1338 microversion: 2.20 time: 0.209727 Jun 16 21:13:29.762095 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:29 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1338 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:29.777945 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d124fca0-4d9d-4a15-8e61-a473a991c933 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:29.778872 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d124fca0-4d9d-4a15-8e61-a473a991c933 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:29.806142 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d124fca0-4d9d-4a15-8e61-a473a991c933 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:29.806609 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d124fca0-4d9d-4a15-8e61-a473a991c933 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:29.807400 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d124fca0-4d9d-4a15-8e61-a473a991c933 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:29.807828 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d124fca0-4d9d-4a15-8e61-a473a991c933 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:29.863229 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-148c3326-d192-46aa-aec5-d423d06632bb tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:29.879493 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-148c3326-d192-46aa-aec5-d423d06632bb tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 1.087225 Jun 16 21:13:29.880578 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 34/69] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:28 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:30.074409 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d124fca0-4d9d-4a15-8e61-a473a991c933 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:30.090479 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d124fca0-4d9d-4a15-8e61-a473a991c933 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1295 microversion: 2.1 time: 0.327100 Jun 16 21:13:30.104336 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 36/70] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:29 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1295 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:30.551180 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-38e08418-5134-4e4b-b05a-c3bf5ee9a3db tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:30.551799 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-38e08418-5134-4e4b-b05a-c3bf5ee9a3db tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:30.560779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-38e08418-5134-4e4b-b05a-c3bf5ee9a3db tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:30.561219 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-38e08418-5134-4e4b-b05a-c3bf5ee9a3db tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:30.561992 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-38e08418-5134-4e4b-b05a-c3bf5ee9a3db tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:30.562422 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-38e08418-5134-4e4b-b05a-c3bf5ee9a3db tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:30.783943 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f69d5924-a676-482c-8da5-a4894f784233 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:30.784636 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f69d5924-a676-482c-8da5-a4894f784233 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:30.798107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f69d5924-a676-482c-8da5-a4894f784233 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:30.798556 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f69d5924-a676-482c-8da5-a4894f784233 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:30.799331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f69d5924-a676-482c-8da5-a4894f784233 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:30.799759 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f69d5924-a676-482c-8da5-a4894f784233 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:30.842094 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-38e08418-5134-4e4b-b05a-c3bf5ee9a3db tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:30.859095 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-38e08418-5134-4e4b-b05a-c3bf5ee9a3db tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1299 microversion: 2.1 time: 0.306064 Jun 16 21:13:30.861625 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 35/71] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:30 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1299 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:30.900931 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0bd95e9a-53ba-495f-8573-112e202e68a4 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:30.902376 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0bd95e9a-53ba-495f-8573-112e202e68a4 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:30.926249 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0bd95e9a-53ba-495f-8573-112e202e68a4 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:30.927879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0bd95e9a-53ba-495f-8573-112e202e68a4 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:30.932274 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0bd95e9a-53ba-495f-8573-112e202e68a4 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:30.933029 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0bd95e9a-53ba-495f-8573-112e202e68a4 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:30.949739 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f69d5924-a676-482c-8da5-a4894f784233 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:30.958990 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f69d5924-a676-482c-8da5-a4894f784233 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:30.969745 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f69d5924-a676-482c-8da5-a4894f784233 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:30.971323 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f69d5924-a676-482c-8da5-a4894f784233 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1338 microversion: 2.20 time: 0.191616 Jun 16 21:13:30.972285 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:30 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1338 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:13:31.119449 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7ebf955c-48ce-4402-a583-be9a81080797 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:31.120335 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7ebf955c-48ce-4402-a583-be9a81080797 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:31.130277 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7ebf955c-48ce-4402-a583-be9a81080797 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:31.131342 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7ebf955c-48ce-4402-a583-be9a81080797 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:31.133564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7ebf955c-48ce-4402-a583-be9a81080797 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:31.136419 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7ebf955c-48ce-4402-a583-be9a81080797 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:31.376245 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7ebf955c-48ce-4402-a583-be9a81080797 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:31.390589 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7ebf955c-48ce-4402-a583-be9a81080797 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1295 microversion: 2.1 time: 0.274964 Jun 16 21:13:31.396197 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 38/73] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:31 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1295 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:31.877512 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-992c21ba-67d1-468f-90b8-ce9cdb5e666d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:31.878529 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-992c21ba-67d1-468f-90b8-ce9cdb5e666d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:31.904901 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-992c21ba-67d1-468f-90b8-ce9cdb5e666d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:31.907066 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-992c21ba-67d1-468f-90b8-ce9cdb5e666d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:31.908034 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-992c21ba-67d1-468f-90b8-ce9cdb5e666d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:31.908959 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-992c21ba-67d1-468f-90b8-ce9cdb5e666d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:32.587733 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:32.833669 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0bd95e9a-53ba-495f-8573-112e202e68a4 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:32.850319 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0bd95e9a-53ba-495f-8573-112e202e68a4 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 1.956962 Jun 16 21:13:32.851538 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 36/74] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:30 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:32.858466 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-698969cc-40d6-4e62-86fc-bb8b7c707751 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:32.865226 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-698969cc-40d6-4e62-86fc-bb8b7c707751 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:32.878482 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-698969cc-40d6-4e62-86fc-bb8b7c707751 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:32.880757 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-698969cc-40d6-4e62-86fc-bb8b7c707751 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:32.885877 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-698969cc-40d6-4e62-86fc-bb8b7c707751 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:32.886549 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-698969cc-40d6-4e62-86fc-bb8b7c707751 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:33.471171 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-992c21ba-67d1-468f-90b8-ce9cdb5e666d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:33.490320 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-992c21ba-67d1-468f-90b8-ce9cdb5e666d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 1.617548 Jun 16 21:13:33.508527 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 39/75] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:31 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:33.513437 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-50d9f126-c2d5-4ba9-be73-c4f9b9b4333f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:33.514055 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-50d9f126-c2d5-4ba9-be73-c4f9b9b4333f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:33.558596 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-50d9f126-c2d5-4ba9-be73-c4f9b9b4333f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:33.560665 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-50d9f126-c2d5-4ba9-be73-c4f9b9b4333f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:33.561614 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-50d9f126-c2d5-4ba9-be73-c4f9b9b4333f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:33.563296 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-50d9f126-c2d5-4ba9-be73-c4f9b9b4333f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:33.774472 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-50d9f126-c2d5-4ba9-be73-c4f9b9b4333f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:33.789761 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-50d9f126-c2d5-4ba9-be73-c4f9b9b4333f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1295 microversion: 2.1 time: 0.278764 Jun 16 21:13:33.792443 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 40/76] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:33 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1295 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:33.903783 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-698969cc-40d6-4e62-86fc-bb8b7c707751 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:33.921444 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-698969cc-40d6-4e62-86fc-bb8b7c707751 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:33.926630 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-698969cc-40d6-4e62-86fc-bb8b7c707751 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:33.928548 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-698969cc-40d6-4e62-86fc-bb8b7c707751 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 1.075759 Jun 16 21:13:33.931500 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 37/77] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:32 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:33.942568 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8f2c7601-b95f-4ea4-aa06-db51106d1411 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:33.946242 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8f2c7601-b95f-4ea4-aa06-db51106d1411 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:33.959197 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8f2c7601-b95f-4ea4-aa06-db51106d1411 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:33.959645 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8f2c7601-b95f-4ea4-aa06-db51106d1411 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:33.962234 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8f2c7601-b95f-4ea4-aa06-db51106d1411 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:33.966224 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8f2c7601-b95f-4ea4-aa06-db51106d1411 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:34.034032 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-fff7c70e-d69d-4107-a03c-eb3a442bcf02 req-8adc83fc-09ac-43d6-ad26-617d895f6e6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feac2ab9-4107-4a96-a6b7-07687b5e151a", "tag": "f058b8da-9aa3-4e1a-b261-fd6763f4e167"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:13:34.061675 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-fff7c70e-d69d-4107-a03c-eb3a442bcf02 req-8adc83fc-09ac-43d6-ad26-617d895f6e6a service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:34.064672 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-fff7c70e-d69d-4107-a03c-eb3a442bcf02 req-8adc83fc-09ac-43d6-ad26-617d895f6e6a service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:34.084776 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=100 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:34.100055 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-fff7c70e-d69d-4107-a03c-eb3a442bcf02 req-8adc83fc-09ac-43d6-ad26-617d895f6e6a service nova] Creating event network-changed:f058b8da-9aa3-4e1a-b261-fd6763f4e167 for instance feac2ab9-4107-4a96-a6b7-07687b5e151a on hv-cinder-81914 Jun 16 21:13:34.101602 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-fff7c70e-d69d-4107-a03c-eb3a442bcf02 req-8adc83fc-09ac-43d6-ad26-617d895f6e6a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117737) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 21:13:34.103746 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5e92f946-bd1f-4598-a499-799ca0a21638 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:34.104773 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5e92f946-bd1f-4598-a499-799ca0a21638 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:34.106488 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5e92f946-bd1f-4598-a499-799ca0a21638 None None] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:34.107433 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5e92f946-bd1f-4598-a499-799ca0a21638 None None] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:34.121301 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.compute.rpcapi [None req-5e92f946-bd1f-4598-a499-799ca0a21638 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 21:13:34.124834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5e92f946-bd1f-4598-a499-799ca0a21638 None None] Releasing lock "compute-rpcapi-router" {{(pid=117737) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 21:13:34.160208 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5e92f946-bd1f-4598-a499-799ca0a21638 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.366281 Jun 16 21:13:34.161293 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 41/78] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:34.516519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a4df23ae-e12f-4020-8ac8-0cbed688d0eb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:34.517254 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a4df23ae-e12f-4020-8ac8-0cbed688d0eb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:34.537945 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a4df23ae-e12f-4020-8ac8-0cbed688d0eb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:34.540745 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a4df23ae-e12f-4020-8ac8-0cbed688d0eb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:34.542889 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a4df23ae-e12f-4020-8ac8-0cbed688d0eb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:34.544287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a4df23ae-e12f-4020-8ac8-0cbed688d0eb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:34.677569 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8f2c7601-b95f-4ea4-aa06-db51106d1411 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:34.690719 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8f2c7601-b95f-4ea4-aa06-db51106d1411 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 0.757938 Jun 16 21:13:34.712332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 38/79] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:33 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:34.807405 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-04c42580-9b5d-4b5e-bc95-ba9245875b00 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:34.808330 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-04c42580-9b5d-4b5e-bc95-ba9245875b00 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:34.819747 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04c42580-9b5d-4b5e-bc95-ba9245875b00 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:34.820492 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04c42580-9b5d-4b5e-bc95-ba9245875b00 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:34.821283 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04c42580-9b5d-4b5e-bc95-ba9245875b00 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:34.821709 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04c42580-9b5d-4b5e-bc95-ba9245875b00 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:34.822262 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=6 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:34.865598 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=26 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:35.079630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a4df23ae-e12f-4020-8ac8-0cbed688d0eb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:35.090996 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a4df23ae-e12f-4020-8ac8-0cbed688d0eb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.584232 Jun 16 21:13:35.096636 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 42/80] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:34 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:35.112828 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-6f9dc7f0-bb1f-42f2-b358-5a2197d86e69 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:35.116049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-6f9dc7f0-bb1f-42f2-b358-5a2197d86e69 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:35.134765 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=18 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:35.147086 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6f9dc7f0-bb1f-42f2-b358-5a2197d86e69 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:35.149452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6f9dc7f0-bb1f-42f2-b358-5a2197d86e69 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:35.150806 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6f9dc7f0-bb1f-42f2-b358-5a2197d86e69 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:35.156658 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6f9dc7f0-bb1f-42f2-b358-5a2197d86e69 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:35.550332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-04c42580-9b5d-4b5e-bc95-ba9245875b00 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:35.583394 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-04c42580-9b5d-4b5e-bc95-ba9245875b00 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.778723 Jun 16 21:13:35.601676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 39/81] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:34 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:35.712269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-af49418c-f9aa-4c3e-94dd-e49516307f8d tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:35.713311 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-af49418c-f9aa-4c3e-94dd-e49516307f8d tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:35.718913 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:35.744654 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-af49418c-f9aa-4c3e-94dd-e49516307f8d tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:35.745949 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-af49418c-f9aa-4c3e-94dd-e49516307f8d tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:35.747773 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-af49418c-f9aa-4c3e-94dd-e49516307f8d tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:35.755982 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-af49418c-f9aa-4c3e-94dd-e49516307f8d tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:35.773723 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6f9dc7f0-bb1f-42f2-b358-5a2197d86e69 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:35.787791 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6f9dc7f0-bb1f-42f2-b358-5a2197d86e69 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:35.794273 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6f9dc7f0-bb1f-42f2-b358-5a2197d86e69 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:35.797691 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-6f9dc7f0-bb1f-42f2-b358-5a2197d86e69 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.692832 Jun 16 21:13:35.798693 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 43/82] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:35 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:36.114978 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-18309e96-7e9d-45bc-8f87-81a1da8336d0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:36.115801 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-18309e96-7e9d-45bc-8f87-81a1da8336d0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:36.128907 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=5 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:36.133283 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-18309e96-7e9d-45bc-8f87-81a1da8336d0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:36.140081 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-18309e96-7e9d-45bc-8f87-81a1da8336d0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:36.142872 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-18309e96-7e9d-45bc-8f87-81a1da8336d0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:36.144298 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-18309e96-7e9d-45bc-8f87-81a1da8336d0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:37.033181 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-18309e96-7e9d-45bc-8f87-81a1da8336d0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:37.058453 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-18309e96-7e9d-45bc-8f87-81a1da8336d0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.946697 Jun 16 21:13:37.060865 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 44/83] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:36 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:37.065773 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d6bf274d-9af1-4200-81fc-fe3ccdd5f230 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:37.077082 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d6bf274d-9af1-4200-81fc-fe3ccdd5f230 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:37.093683 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d6bf274d-9af1-4200-81fc-fe3ccdd5f230 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:37.094448 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d6bf274d-9af1-4200-81fc-fe3ccdd5f230 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:37.096667 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d6bf274d-9af1-4200-81fc-fe3ccdd5f230 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:37.097339 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d6bf274d-9af1-4200-81fc-fe3ccdd5f230 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:37.181931 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-af49418c-f9aa-4c3e-94dd-e49516307f8d tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:37.197125 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-af49418c-f9aa-4c3e-94dd-e49516307f8d tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 1.491952 Jun 16 21:13:37.200164 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 40/84] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:35 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:37.213712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a4f85e58-2f18-4f24-9385-abdd5daa4292 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:37.218776 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a4f85e58-2f18-4f24-9385-abdd5daa4292 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:37.229935 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a4f85e58-2f18-4f24-9385-abdd5daa4292 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:37.231831 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a4f85e58-2f18-4f24-9385-abdd5daa4292 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:37.232896 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a4f85e58-2f18-4f24-9385-abdd5daa4292 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:37.233543 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a4f85e58-2f18-4f24-9385-abdd5daa4292 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:37.540674 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d6bf274d-9af1-4200-81fc-fe3ccdd5f230 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:37.557971 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d6bf274d-9af1-4200-81fc-fe3ccdd5f230 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.495022 Jun 16 21:13:37.567484 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 45/85] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:37 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:37.670638 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a4f85e58-2f18-4f24-9385-abdd5daa4292 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:37.680598 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a4f85e58-2f18-4f24-9385-abdd5daa4292 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:37.706740 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a4f85e58-2f18-4f24-9385-abdd5daa4292 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:37.716836 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a4f85e58-2f18-4f24-9385-abdd5daa4292 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.505999 Jun 16 21:13:37.721005 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 41/86] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:37 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:37.735760 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-8dafc774-7193-4dce-82ee-e7d55b41c8e4 req-a4f1ab9f-061d-4499-86f5-5d3ce8c3970f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397f70d9-d52e-42e2-9d9c-a5921d7632a0", "tag": "b0b64745-4342-4163-bc5d-724401da0c19"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:13:37.763810 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-8dafc774-7193-4dce-82ee-e7d55b41c8e4 req-a4f1ab9f-061d-4499-86f5-5d3ce8c3970f service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:37.770107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-8dafc774-7193-4dce-82ee-e7d55b41c8e4 req-a4f1ab9f-061d-4499-86f5-5d3ce8c3970f service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:37.807858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-8dafc774-7193-4dce-82ee-e7d55b41c8e4 req-a4f1ab9f-061d-4499-86f5-5d3ce8c3970f service nova] Creating event network-changed:b0b64745-4342-4163-bc5d-724401da0c19 for instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 on hv-cinder-81914 Jun 16 21:13:37.835599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-8dafc774-7193-4dce-82ee-e7d55b41c8e4 req-a4f1ab9f-061d-4499-86f5-5d3ce8c3970f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104616 Jun 16 21:13:37.838817 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 46/87] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:38.080111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d69855de-c840-4d48-a186-24515a53cfdf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:38.080959 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d69855de-c840-4d48-a186-24515a53cfdf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:38.095288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d69855de-c840-4d48-a186-24515a53cfdf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:38.096265 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d69855de-c840-4d48-a186-24515a53cfdf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:38.097466 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d69855de-c840-4d48-a186-24515a53cfdf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:38.098120 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d69855de-c840-4d48-a186-24515a53cfdf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:38.156646 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=100 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:38.226386 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-abccc821-921e-459d-824e-7e8b8852d3df tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:38.227186 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-abccc821-921e-459d-824e-7e8b8852d3df tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:38.246723 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-abccc821-921e-459d-824e-7e8b8852d3df tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:38.249144 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-abccc821-921e-459d-824e-7e8b8852d3df tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:38.258025 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-abccc821-921e-459d-824e-7e8b8852d3df tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:38.258495 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-abccc821-921e-459d-824e-7e8b8852d3df tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:38.970633 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d69855de-c840-4d48-a186-24515a53cfdf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:38.984869 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d69855de-c840-4d48-a186-24515a53cfdf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.907225 Jun 16 21:13:38.990169 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 42/88] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:38 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:39.276477 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-2e1e4ce8-e0ea-4004-9747-3dbed0aec49f req-d56b154e-6a63-43e4-9ded-4c8aa491c5ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2281b8c3-ec1f-478b-bd50-128d5cf67a04", "tag": "6473309c-d2e4-42b4-94b1-6b373a5e59f2"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:13:39.313085 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-2e1e4ce8-e0ea-4004-9747-3dbed0aec49f req-d56b154e-6a63-43e4-9ded-4c8aa491c5ae service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:39.313868 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-2e1e4ce8-e0ea-4004-9747-3dbed0aec49f req-d56b154e-6a63-43e4-9ded-4c8aa491c5ae service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:39.407945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-2e1e4ce8-e0ea-4004-9747-3dbed0aec49f req-d56b154e-6a63-43e4-9ded-4c8aa491c5ae service nova] Creating event network-changed:6473309c-d2e4-42b4-94b1-6b373a5e59f2 for instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 on hv-cinder-81914 Jun 16 21:13:39.411430 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-2e1e4ce8-e0ea-4004-9747-3dbed0aec49f req-d56b154e-6a63-43e4-9ded-4c8aa491c5ae service nova] Acquired lock "compute-rpcapi-router" {{(pid=117738) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 21:13:39.422272 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5a09951c-c22f-41d0-852e-a86dd25d1009 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:39.425251 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5a09951c-c22f-41d0-852e-a86dd25d1009 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:39.431444 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5a09951c-c22f-41d0-852e-a86dd25d1009 None None] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:39.435300 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5a09951c-c22f-41d0-852e-a86dd25d1009 None None] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:39.447976 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-abccc821-921e-459d-824e-7e8b8852d3df tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:39.448484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.compute.rpcapi [None req-5a09951c-c22f-41d0-852e-a86dd25d1009 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 21:13:39.448573 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-abccc821-921e-459d-824e-7e8b8852d3df tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 1.230245 Jun 16 21:13:39.448645 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5a09951c-c22f-41d0-852e-a86dd25d1009 None None] Releasing lock "compute-rpcapi-router" {{(pid=117738) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 21:13:39.462242 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 47/89] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:38 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:39.469308 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-3dc082d5-4da8-45c2-a324-4920c6ed215e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:39.470000 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-3dc082d5-4da8-45c2-a324-4920c6ed215e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:39.477026 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3dc082d5-4da8-45c2-a324-4920c6ed215e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:39.478946 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3dc082d5-4da8-45c2-a324-4920c6ed215e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:39.479987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3dc082d5-4da8-45c2-a324-4920c6ed215e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:39.480866 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3dc082d5-4da8-45c2-a324-4920c6ed215e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:39.534387 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5a09951c-c22f-41d0-852e-a86dd25d1009 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.537020 Jun 16 21:13:39.535558 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 43/90] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:39.544654 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3d1ae8dd-50bb-4d38-ba47-78dbfa6bb19b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:39.545592 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-3d1ae8dd-50bb-4d38-ba47-78dbfa6bb19b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:39.561877 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3d1ae8dd-50bb-4d38-ba47-78dbfa6bb19b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:39.562624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3d1ae8dd-50bb-4d38-ba47-78dbfa6bb19b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:39.577591 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3d1ae8dd-50bb-4d38-ba47-78dbfa6bb19b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:39.578344 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3d1ae8dd-50bb-4d38-ba47-78dbfa6bb19b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:40.344390 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3dc082d5-4da8-45c2-a324-4920c6ed215e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:40.367576 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-3dc082d5-4da8-45c2-a324-4920c6ed215e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.898517 Jun 16 21:13:40.368246 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 48/91] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:39 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:40.392979 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-dbeb2355-34d6-4a39-98df-e40104e9e1cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:40.393623 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-dbeb2355-34d6-4a39-98df-e40104e9e1cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:40.414358 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dbeb2355-34d6-4a39-98df-e40104e9e1cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:40.414800 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dbeb2355-34d6-4a39-98df-e40104e9e1cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:40.415564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dbeb2355-34d6-4a39-98df-e40104e9e1cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:40.415988 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dbeb2355-34d6-4a39-98df-e40104e9e1cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:40.469303 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-3d1ae8dd-50bb-4d38-ba47-78dbfa6bb19b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:40.482171 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-3d1ae8dd-50bb-4d38-ba47-78dbfa6bb19b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:40.491058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-3d1ae8dd-50bb-4d38-ba47-78dbfa6bb19b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:40.492706 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-3d1ae8dd-50bb-4d38-ba47-78dbfa6bb19b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.955716 Jun 16 21:13:40.496621 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 44/92] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:39 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:40.501676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-ff8c1a6f-eafc-43b8-a075-48e391710b1e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:40.511999 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-ff8c1a6f-eafc-43b8-a075-48e391710b1e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:40.522111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ff8c1a6f-eafc-43b8-a075-48e391710b1e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:40.524385 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ff8c1a6f-eafc-43b8-a075-48e391710b1e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:40.525412 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ff8c1a6f-eafc-43b8-a075-48e391710b1e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:40.527280 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ff8c1a6f-eafc-43b8-a075-48e391710b1e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:40.714920 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-dbeb2355-34d6-4a39-98df-e40104e9e1cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:40.724239 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-dbeb2355-34d6-4a39-98df-e40104e9e1cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.351955 Jun 16 21:13:40.725538 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 49/93] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:40 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:40.842462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-ff8c1a6f-eafc-43b8-a075-48e391710b1e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:40.854039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-ff8c1a6f-eafc-43b8-a075-48e391710b1e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 0.355883 Jun 16 21:13:40.857080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 45/94] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:40 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:41.390045 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-17fae95d-b1b6-4e5d-bb6e-0babf1e7861f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:41.390828 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-17fae95d-b1b6-4e5d-bb6e-0babf1e7861f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:41.403294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-17fae95d-b1b6-4e5d-bb6e-0babf1e7861f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:41.404724 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-17fae95d-b1b6-4e5d-bb6e-0babf1e7861f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:41.406171 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-17fae95d-b1b6-4e5d-bb6e-0babf1e7861f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:41.406609 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-17fae95d-b1b6-4e5d-bb6e-0babf1e7861f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:41.512205 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d00c6e75-d3a2-41a7-a401-1e83325a3188 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:41.513116 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d00c6e75-d3a2-41a7-a401-1e83325a3188 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:41.530949 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d00c6e75-d3a2-41a7-a401-1e83325a3188 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:41.531995 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d00c6e75-d3a2-41a7-a401-1e83325a3188 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:41.534088 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d00c6e75-d3a2-41a7-a401-1e83325a3188 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:41.534861 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d00c6e75-d3a2-41a7-a401-1e83325a3188 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:41.640535 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-17fae95d-b1b6-4e5d-bb6e-0babf1e7861f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:41.649734 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-17fae95d-b1b6-4e5d-bb6e-0babf1e7861f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.266300 Jun 16 21:13:41.650744 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 50/95] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:41 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:41.662335 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-0d126e41-191e-46d2-88ca-5433f76e7213 req-d90fb158-28b2-49e9-b5d9-46e495acd7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "499ae55d-60f9-480c-9ecd-794a1cee0da5", "tag": "49dfc0a9-3807-4075-a9a7-5f2dceb98537"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:13:41.671063 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-0d126e41-191e-46d2-88ca-5433f76e7213 req-d90fb158-28b2-49e9-b5d9-46e495acd7f3 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:41.671703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-0d126e41-191e-46d2-88ca-5433f76e7213 req-d90fb158-28b2-49e9-b5d9-46e495acd7f3 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:41.685018 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-0d126e41-191e-46d2-88ca-5433f76e7213 req-d90fb158-28b2-49e9-b5d9-46e495acd7f3 service nova] Creating event network-changed:49dfc0a9-3807-4075-a9a7-5f2dceb98537 for instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 on hv-cinder-81914 Jun 16 21:13:41.690438 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-0d126e41-191e-46d2-88ca-5433f76e7213 req-d90fb158-28b2-49e9-b5d9-46e495acd7f3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038353 Jun 16 21:13:41.691345 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 51/96] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:41.732390 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d00c6e75-d3a2-41a7-a401-1e83325a3188 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:41.744322 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d00c6e75-d3a2-41a7-a401-1e83325a3188 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:41.744972 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a6d4420e-e2f0-472f-8616-b4a93a274475 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:41.745668 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a6d4420e-e2f0-472f-8616-b4a93a274475 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:41.745819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d00c6e75-d3a2-41a7-a401-1e83325a3188 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:41.747313 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d00c6e75-d3a2-41a7-a401-1e83325a3188 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.239733 Jun 16 21:13:41.747892 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 46/97] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:41 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:41.751932 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a6d4420e-e2f0-472f-8616-b4a93a274475 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:41.752421 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a6d4420e-e2f0-472f-8616-b4a93a274475 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:41.753177 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a6d4420e-e2f0-472f-8616-b4a93a274475 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:41.753601 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a6d4420e-e2f0-472f-8616-b4a93a274475 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:41.875524 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-93a4c13d-f935-46b1-8fdb-d4799dda9d4f tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:41.876255 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-93a4c13d-f935-46b1-8fdb-d4799dda9d4f tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:41.882867 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-93a4c13d-f935-46b1-8fdb-d4799dda9d4f tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:41.883410 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-93a4c13d-f935-46b1-8fdb-d4799dda9d4f tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:41.887100 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-93a4c13d-f935-46b1-8fdb-d4799dda9d4f tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:41.887100 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-93a4c13d-f935-46b1-8fdb-d4799dda9d4f tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:41.907396 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a6d4420e-e2f0-472f-8616-b4a93a274475 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:41.918630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a6d4420e-e2f0-472f-8616-b4a93a274475 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.178344 Jun 16 21:13:41.919395 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 52/98] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:41 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:42.033162 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-93a4c13d-f935-46b1-8fdb-d4799dda9d4f tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:42.043103 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-93a4c13d-f935-46b1-8fdb-d4799dda9d4f tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 0.172361 Jun 16 21:13:42.043686 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 47/99] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:41 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:42.669295 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1004754f-aa8c-4af3-a9a6-b79e1a4be930 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:42.671050 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1004754f-aa8c-4af3-a9a6-b79e1a4be930 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:42.685627 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1004754f-aa8c-4af3-a9a6-b79e1a4be930 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:42.686382 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1004754f-aa8c-4af3-a9a6-b79e1a4be930 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:42.687603 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1004754f-aa8c-4af3-a9a6-b79e1a4be930 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:42.688345 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1004754f-aa8c-4af3-a9a6-b79e1a4be930 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:42.768092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9cbd2d3b-5b8d-45b8-b166-0ceeaebf5186 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:42.772219 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-9cbd2d3b-5b8d-45b8-b166-0ceeaebf5186 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:42.785606 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9cbd2d3b-5b8d-45b8-b166-0ceeaebf5186 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:42.786050 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9cbd2d3b-5b8d-45b8-b166-0ceeaebf5186 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:42.786845 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9cbd2d3b-5b8d-45b8-b166-0ceeaebf5186 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:42.788670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9cbd2d3b-5b8d-45b8-b166-0ceeaebf5186 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:43.006633 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1004754f-aa8c-4af3-a9a6-b79e1a4be930 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:43.022304 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1004754f-aa8c-4af3-a9a6-b79e1a4be930 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.359010 Jun 16 21:13:43.024207 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 53/100] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:42 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:43.038734 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-db83ae64-cee5-4119-b6a3-69c102019792 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:43.046084 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-db83ae64-cee5-4119-b6a3-69c102019792 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:43.062329 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-db83ae64-cee5-4119-b6a3-69c102019792 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:43.063048 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-db83ae64-cee5-4119-b6a3-69c102019792 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:43.063974 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-db83ae64-cee5-4119-b6a3-69c102019792 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:43.064581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-db83ae64-cee5-4119-b6a3-69c102019792 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:43.275062 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9cbd2d3b-5b8d-45b8-b166-0ceeaebf5186 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:43.296300 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9cbd2d3b-5b8d-45b8-b166-0ceeaebf5186 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:43.297193 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-db83ae64-cee5-4119-b6a3-69c102019792 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:43.301967 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9cbd2d3b-5b8d-45b8-b166-0ceeaebf5186 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:43.305869 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-9cbd2d3b-5b8d-45b8-b166-0ceeaebf5186 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.543062 Jun 16 21:13:43.306166 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-db83ae64-cee5-4119-b6a3-69c102019792 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.280879 Jun 16 21:13:43.307239 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 48/101] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:42 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:43.313125 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 54/102] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:43 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:43.321217 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1c36314c-1cd0-4d0d-b00d-25857142f374 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:43.324575 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1c36314c-1cd0-4d0d-b00d-25857142f374 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:43.332693 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1c36314c-1cd0-4d0d-b00d-25857142f374 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:43.334185 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1c36314c-1cd0-4d0d-b00d-25857142f374 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:43.335721 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1c36314c-1cd0-4d0d-b00d-25857142f374 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:43.336269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1c36314c-1cd0-4d0d-b00d-25857142f374 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:43.582422 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1c36314c-1cd0-4d0d-b00d-25857142f374 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:43.594682 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1c36314c-1cd0-4d0d-b00d-25857142f374 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 0.285986 Jun 16 21:13:43.596944 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 49/103] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:43 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:44.042144 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8b2f9df3-8ec2-4ea3-95af-c764fc4e26a0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:44.042972 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8b2f9df3-8ec2-4ea3-95af-c764fc4e26a0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:44.053266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8b2f9df3-8ec2-4ea3-95af-c764fc4e26a0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:44.054083 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8b2f9df3-8ec2-4ea3-95af-c764fc4e26a0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:44.057857 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8b2f9df3-8ec2-4ea3-95af-c764fc4e26a0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:44.060655 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8b2f9df3-8ec2-4ea3-95af-c764fc4e26a0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:44.119134 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:44.245968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8b2f9df3-8ec2-4ea3-95af-c764fc4e26a0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:44.255274 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8b2f9df3-8ec2-4ea3-95af-c764fc4e26a0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.218837 Jun 16 21:13:44.260213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 55/104] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:44 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:44.325363 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-814d591d-9241-4c56-93ca-d2bbaab93a3f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:44.326160 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-64479f1a-6362-47fc-a0e2-7a7f6eab4f1a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:44.326926 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-814d591d-9241-4c56-93ca-d2bbaab93a3f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:44.327793 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-64479f1a-6362-47fc-a0e2-7a7f6eab4f1a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:44.334418 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-814d591d-9241-4c56-93ca-d2bbaab93a3f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:44.334604 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-64479f1a-6362-47fc-a0e2-7a7f6eab4f1a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:44.335151 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-814d591d-9241-4c56-93ca-d2bbaab93a3f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:44.335418 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-64479f1a-6362-47fc-a0e2-7a7f6eab4f1a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:44.336417 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-64479f1a-6362-47fc-a0e2-7a7f6eab4f1a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:44.337169 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-814d591d-9241-4c56-93ca-d2bbaab93a3f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:44.337834 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-64479f1a-6362-47fc-a0e2-7a7f6eab4f1a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:44.337961 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-814d591d-9241-4c56-93ca-d2bbaab93a3f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:44.502020 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-814d591d-9241-4c56-93ca-d2bbaab93a3f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:44.512465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-814d591d-9241-4c56-93ca-d2bbaab93a3f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:44.514315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-814d591d-9241-4c56-93ca-d2bbaab93a3f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:44.515736 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-814d591d-9241-4c56-93ca-d2bbaab93a3f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.194649 Jun 16 21:13:44.527386 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 56/105] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:44 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:44.598875 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-64479f1a-6362-47fc-a0e2-7a7f6eab4f1a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:44.610083 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-64479f1a-6362-47fc-a0e2-7a7f6eab4f1a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.288538 Jun 16 21:13:44.614431 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f8026f6c-19be-4c59-8c01-1422ba415a92 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:44.623729 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f8026f6c-19be-4c59-8c01-1422ba415a92 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:44.623917 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 50/106] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:44 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:44.638654 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f8026f6c-19be-4c59-8c01-1422ba415a92 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:44.646566 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f8026f6c-19be-4c59-8c01-1422ba415a92 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:44.648251 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f8026f6c-19be-4c59-8c01-1422ba415a92 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:44.649269 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f8026f6c-19be-4c59-8c01-1422ba415a92 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:45.114862 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f8026f6c-19be-4c59-8c01-1422ba415a92 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:45.126461 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f8026f6c-19be-4c59-8c01-1422ba415a92 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 0.516707 Jun 16 21:13:45.138471 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 57/107] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:44 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:45.272597 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-03f453c2-ad9e-4cfc-bedc-065b77d19eb9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:45.273664 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-03f453c2-ad9e-4cfc-bedc-065b77d19eb9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:45.283141 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-03f453c2-ad9e-4cfc-bedc-065b77d19eb9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:45.285190 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-03f453c2-ad9e-4cfc-bedc-065b77d19eb9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:45.287296 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-03f453c2-ad9e-4cfc-bedc-065b77d19eb9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:45.289127 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-03f453c2-ad9e-4cfc-bedc-065b77d19eb9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:45.536825 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-63350837-1ece-469c-9a6a-06e6a8911ff9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:45.537972 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-63350837-1ece-469c-9a6a-06e6a8911ff9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:45.547799 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-63350837-1ece-469c-9a6a-06e6a8911ff9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:45.550617 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-63350837-1ece-469c-9a6a-06e6a8911ff9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:45.554884 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-63350837-1ece-469c-9a6a-06e6a8911ff9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:45.555992 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-63350837-1ece-469c-9a6a-06e6a8911ff9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:45.745702 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-03f453c2-ad9e-4cfc-bedc-065b77d19eb9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:45.753593 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-03f453c2-ad9e-4cfc-bedc-065b77d19eb9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.485044 Jun 16 21:13:45.754147 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 51/108] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:45 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:45.778831 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-29d385aa-537b-4dfa-b984-6d398874a6b1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:45.779676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-29d385aa-537b-4dfa-b984-6d398874a6b1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:45.805720 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-29d385aa-537b-4dfa-b984-6d398874a6b1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:45.806798 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-29d385aa-537b-4dfa-b984-6d398874a6b1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:45.807945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-29d385aa-537b-4dfa-b984-6d398874a6b1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:45.808566 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-29d385aa-537b-4dfa-b984-6d398874a6b1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:45.903207 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-63350837-1ece-469c-9a6a-06e6a8911ff9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:45.932284 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-63350837-1ece-469c-9a6a-06e6a8911ff9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:45.936384 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-63350837-1ece-469c-9a6a-06e6a8911ff9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:45.937748 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-63350837-1ece-469c-9a6a-06e6a8911ff9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.406642 Jun 16 21:13:45.941137 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 58/109] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:45 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:46.142786 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-04d903f9-5ca6-4f30-ad0e-d6f4b763857a tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:46.143399 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-04d903f9-5ca6-4f30-ad0e-d6f4b763857a tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:46.162156 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-04d903f9-5ca6-4f30-ad0e-d6f4b763857a tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:46.162612 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-04d903f9-5ca6-4f30-ad0e-d6f4b763857a tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:46.163538 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-04d903f9-5ca6-4f30-ad0e-d6f4b763857a tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:46.163978 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-04d903f9-5ca6-4f30-ad0e-d6f4b763857a tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:46.199845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=100 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:46.400024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-04d903f9-5ca6-4f30-ad0e-d6f4b763857a tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:46.409070 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-04d903f9-5ca6-4f30-ad0e-d6f4b763857a tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 0.270103 Jun 16 21:13:46.411296 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 59/110] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:46 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:46.478873 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-29d385aa-537b-4dfa-b984-6d398874a6b1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:46.489600 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-29d385aa-537b-4dfa-b984-6d398874a6b1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.734227 Jun 16 21:13:46.491060 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 52/111] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:45 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:46.775030 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-010f6b85-fe5a-45ce-a5e9-500527e50494 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:46.776777 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-010f6b85-fe5a-45ce-a5e9-500527e50494 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:46.793578 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-010f6b85-fe5a-45ce-a5e9-500527e50494 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:46.794047 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-010f6b85-fe5a-45ce-a5e9-500527e50494 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:46.794839 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-010f6b85-fe5a-45ce-a5e9-500527e50494 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:46.795272 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-010f6b85-fe5a-45ce-a5e9-500527e50494 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:46.925103 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-6c3ee4af-98d6-41b3-be8d-8a19120fe62a req-ce6364c1-3368-47fe-bd17-7463b1869a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feac2ab9-4107-4a96-a6b7-07687b5e151a", "name": "network-vif-plugged", "status": "completed", "tag": "f058b8da-9aa3-4e1a-b261-fd6763f4e167"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:13:46.936567 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-6c3ee4af-98d6-41b3-be8d-8a19120fe62a req-ce6364c1-3368-47fe-bd17-7463b1869a91 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:46.937238 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-6c3ee4af-98d6-41b3-be8d-8a19120fe62a req-ce6364c1-3368-47fe-bd17-7463b1869a91 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:46.955563 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-6c3ee4af-98d6-41b3-be8d-8a19120fe62a req-ce6364c1-3368-47fe-bd17-7463b1869a91 service nova] Creating event network-vif-plugged:f058b8da-9aa3-4e1a-b261-fd6763f4e167 for instance feac2ab9-4107-4a96-a6b7-07687b5e151a on hv-cinder-81914 Jun 16 21:13:46.962443 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-010f6b85-fe5a-45ce-a5e9-500527e50494 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:46.973150 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-010f6b85-fe5a-45ce-a5e9-500527e50494 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.202772 Jun 16 21:13:46.973737 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 60/112] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:46 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:46.975630 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-6c3ee4af-98d6-41b3-be8d-8a19120fe62a req-ce6364c1-3368-47fe-bd17-7463b1869a91 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117842 Jun 16 21:13:46.979012 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 53/113] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:46.985135 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d305a4f5-dfd1-4fd0-9c70-f5579fca4d10 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:46.985847 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d305a4f5-dfd1-4fd0-9c70-f5579fca4d10 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:46.992536 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d305a4f5-dfd1-4fd0-9c70-f5579fca4d10 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:46.993023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d305a4f5-dfd1-4fd0-9c70-f5579fca4d10 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:46.993787 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d305a4f5-dfd1-4fd0-9c70-f5579fca4d10 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:46.994216 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d305a4f5-dfd1-4fd0-9c70-f5579fca4d10 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:47.146266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d305a4f5-dfd1-4fd0-9c70-f5579fca4d10 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:47.155136 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d305a4f5-dfd1-4fd0-9c70-f5579fca4d10 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:47.156917 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d305a4f5-dfd1-4fd0-9c70-f5579fca4d10 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:47.158032 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d305a4f5-dfd1-4fd0-9c70-f5579fca4d10 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.183378 Jun 16 21:13:47.158587 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 61/114] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:46 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:47.428381 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8d6b0aac-1195-45d0-a1d9-ea44b22b59dd tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:47.429483 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8d6b0aac-1195-45d0-a1d9-ea44b22b59dd tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:47.436393 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8d6b0aac-1195-45d0-a1d9-ea44b22b59dd tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:47.436837 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8d6b0aac-1195-45d0-a1d9-ea44b22b59dd tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:47.437730 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8d6b0aac-1195-45d0-a1d9-ea44b22b59dd tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:47.438174 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8d6b0aac-1195-45d0-a1d9-ea44b22b59dd tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:47.507787 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5029cc50-c9db-4208-80ed-d8c198a531de tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:47.509004 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5029cc50-c9db-4208-80ed-d8c198a531de tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:47.519379 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5029cc50-c9db-4208-80ed-d8c198a531de tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:47.520027 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5029cc50-c9db-4208-80ed-d8c198a531de tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:47.523987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5029cc50-c9db-4208-80ed-d8c198a531de tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:47.524660 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5029cc50-c9db-4208-80ed-d8c198a531de tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:47.642043 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8d6b0aac-1195-45d0-a1d9-ea44b22b59dd tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:47.650234 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8d6b0aac-1195-45d0-a1d9-ea44b22b59dd tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 0.226336 Jun 16 21:13:47.656504 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 54/115] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:47 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:47.745915 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5029cc50-c9db-4208-80ed-d8c198a531de tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:47.753658 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5029cc50-c9db-4208-80ed-d8c198a531de tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.250727 Jun 16 21:13:47.754655 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 62/116] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:47 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:47.992409 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5387d828-f958-4546-b1f8-ef7b1fa5e998 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:47.993696 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5387d828-f958-4546-b1f8-ef7b1fa5e998 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:48.000971 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5387d828-f958-4546-b1f8-ef7b1fa5e998 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:48.001438 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5387d828-f958-4546-b1f8-ef7b1fa5e998 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:48.002261 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5387d828-f958-4546-b1f8-ef7b1fa5e998 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:48.002819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5387d828-f958-4546-b1f8-ef7b1fa5e998 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:48.151599 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5387d828-f958-4546-b1f8-ef7b1fa5e998 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:48.159217 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5387d828-f958-4546-b1f8-ef7b1fa5e998 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.171895 Jun 16 21:13:48.159790 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 55/117] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:47 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:48.176113 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-3033f16e-9738-48b3-8d41-302908c729ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:48.176690 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-3033f16e-9738-48b3-8d41-302908c729ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:48.184674 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3033f16e-9738-48b3-8d41-302908c729ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:48.185128 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3033f16e-9738-48b3-8d41-302908c729ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:48.186210 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3033f16e-9738-48b3-8d41-302908c729ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:48.187014 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3033f16e-9738-48b3-8d41-302908c729ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:48.400202 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3033f16e-9738-48b3-8d41-302908c729ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:48.409989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3033f16e-9738-48b3-8d41-302908c729ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:48.412185 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3033f16e-9738-48b3-8d41-302908c729ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:48.413387 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-3033f16e-9738-48b3-8d41-302908c729ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.241046 Jun 16 21:13:48.414372 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 63/118] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:48 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:48.675182 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8863d701-5d63-4ef9-bd50-d44ce6d07f8e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:48.677584 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8863d701-5d63-4ef9-bd50-d44ce6d07f8e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:48.686374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8863d701-5d63-4ef9-bd50-d44ce6d07f8e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:48.687339 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8863d701-5d63-4ef9-bd50-d44ce6d07f8e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:48.688365 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8863d701-5d63-4ef9-bd50-d44ce6d07f8e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:48.689075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8863d701-5d63-4ef9-bd50-d44ce6d07f8e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:48.771483 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-43a5146b-e281-466d-b6a3-e36edf7468a9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:48.772095 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-43a5146b-e281-466d-b6a3-e36edf7468a9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:48.779561 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-43a5146b-e281-466d-b6a3-e36edf7468a9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:48.780091 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-43a5146b-e281-466d-b6a3-e36edf7468a9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:48.780962 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-43a5146b-e281-466d-b6a3-e36edf7468a9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:48.781484 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-43a5146b-e281-466d-b6a3-e36edf7468a9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:48.944449 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-43a5146b-e281-466d-b6a3-e36edf7468a9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:48.952585 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-43a5146b-e281-466d-b6a3-e36edf7468a9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.185364 Jun 16 21:13:48.954557 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 64/119] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:48 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:49.006029 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8863d701-5d63-4ef9-bd50-d44ce6d07f8e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:49.014782 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8863d701-5d63-4ef9-bd50-d44ce6d07f8e tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 0.345598 Jun 16 21:13:49.026051 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 56/120] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:48 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:49.180528 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e4104433-e00e-4788-8178-91c2f674843f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:49.182416 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e4104433-e00e-4788-8178-91c2f674843f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:49.203998 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e4104433-e00e-4788-8178-91c2f674843f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:49.204713 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e4104433-e00e-4788-8178-91c2f674843f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:49.206030 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e4104433-e00e-4788-8178-91c2f674843f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:49.207162 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e4104433-e00e-4788-8178-91c2f674843f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:49.428283 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e4104433-e00e-4788-8178-91c2f674843f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:49.435906 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-fbbb5d4b-8be0-4c48-a7fc-e8aa402a1915 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:49.436945 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e4104433-e00e-4788-8178-91c2f674843f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.263984 Jun 16 21:13:49.437231 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-fbbb5d4b-8be0-4c48-a7fc-e8aa402a1915 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:49.446702 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 65/121] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:49 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:49.449939 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=2 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:49.455998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-fbbb5d4b-8be0-4c48-a7fc-e8aa402a1915 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:49.456494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-fbbb5d4b-8be0-4c48-a7fc-e8aa402a1915 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:49.457361 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-fbbb5d4b-8be0-4c48-a7fc-e8aa402a1915 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:49.458137 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-fbbb5d4b-8be0-4c48-a7fc-e8aa402a1915 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:49.644343 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-fbbb5d4b-8be0-4c48-a7fc-e8aa402a1915 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:49.658220 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-fbbb5d4b-8be0-4c48-a7fc-e8aa402a1915 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:49.659814 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-fbbb5d4b-8be0-4c48-a7fc-e8aa402a1915 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:49.661167 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-fbbb5d4b-8be0-4c48-a7fc-e8aa402a1915 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.229844 Jun 16 21:13:49.661724 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 57/122] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:49 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:13:49.976206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b8de1f10-f5a2-4299-b0a6-4a739b6e620f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:49.977369 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b8de1f10-f5a2-4299-b0a6-4a739b6e620f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:49.983478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b8de1f10-f5a2-4299-b0a6-4a739b6e620f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:49.983929 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b8de1f10-f5a2-4299-b0a6-4a739b6e620f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:49.985157 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b8de1f10-f5a2-4299-b0a6-4a739b6e620f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:49.985717 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b8de1f10-f5a2-4299-b0a6-4a739b6e620f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:50.033632 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-33e8f47f-032b-42a9-94ed-d0645c4d0fd3 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:50.035098 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-33e8f47f-032b-42a9-94ed-d0645c4d0fd3 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:50.042118 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-33e8f47f-032b-42a9-94ed-d0645c4d0fd3 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:50.042789 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-33e8f47f-032b-42a9-94ed-d0645c4d0fd3 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:50.043796 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-33e8f47f-032b-42a9-94ed-d0645c4d0fd3 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:50.044623 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-33e8f47f-032b-42a9-94ed-d0645c4d0fd3 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:50.129752 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b8de1f10-f5a2-4299-b0a6-4a739b6e620f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:50.138012 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b8de1f10-f5a2-4299-b0a6-4a739b6e620f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.166191 Jun 16 21:13:50.138601 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 66/123] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:49 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:50.454839 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ed001a90-42ec-4006-887b-81095b35b438 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:50.455501 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ed001a90-42ec-4006-887b-81095b35b438 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:50.462488 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ed001a90-42ec-4006-887b-81095b35b438 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:50.463042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ed001a90-42ec-4006-887b-81095b35b438 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:50.463888 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ed001a90-42ec-4006-887b-81095b35b438 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:50.464359 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ed001a90-42ec-4006-887b-81095b35b438 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:50.479416 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-33e8f47f-032b-42a9-94ed-d0645c4d0fd3 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:50.487513 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-33e8f47f-032b-42a9-94ed-d0645c4d0fd3 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 0.458047 Jun 16 21:13:50.488099 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 58/124] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:50 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:50.608613 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-ed001a90-42ec-4006-887b-81095b35b438 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:50.617486 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ed001a90-42ec-4006-887b-81095b35b438 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.166826 Jun 16 21:13:50.624290 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 67/125] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:50 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:50.679621 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-daf8d610-4228-4a63-bd9d-5cf4b0681cb4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:50.680684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-daf8d610-4228-4a63-bd9d-5cf4b0681cb4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:50.687794 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-daf8d610-4228-4a63-bd9d-5cf4b0681cb4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:50.688345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-daf8d610-4228-4a63-bd9d-5cf4b0681cb4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:50.689593 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-daf8d610-4228-4a63-bd9d-5cf4b0681cb4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:50.690030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-daf8d610-4228-4a63-bd9d-5cf4b0681cb4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:50.892834 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-daf8d610-4228-4a63-bd9d-5cf4b0681cb4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:50.904448 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-daf8d610-4228-4a63-bd9d-5cf4b0681cb4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:50.911617 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-daf8d610-4228-4a63-bd9d-5cf4b0681cb4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:50.913275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-daf8d610-4228-4a63-bd9d-5cf4b0681cb4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.238294 Jun 16 21:13:50.925294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 59/126] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:50 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:51.155111 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ce13baa5-9117-413b-9f49-97ef0bb9112f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:51.155964 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ce13baa5-9117-413b-9f49-97ef0bb9112f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:51.174738 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ce13baa5-9117-413b-9f49-97ef0bb9112f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:51.175442 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ce13baa5-9117-413b-9f49-97ef0bb9112f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:51.189328 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ce13baa5-9117-413b-9f49-97ef0bb9112f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:51.189785 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ce13baa5-9117-413b-9f49-97ef0bb9112f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:51.422925 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-ce13baa5-9117-413b-9f49-97ef0bb9112f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:51.430923 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ce13baa5-9117-413b-9f49-97ef0bb9112f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.279892 Jun 16 21:13:51.431503 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 68/127] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:51 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:51.504211 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6548503d-7d6e-48e9-910d-ca60ca6a02ef tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:51.505530 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6548503d-7d6e-48e9-910d-ca60ca6a02ef tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:51.512526 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6548503d-7d6e-48e9-910d-ca60ca6a02ef tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:51.512966 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6548503d-7d6e-48e9-910d-ca60ca6a02ef tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:51.513721 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6548503d-7d6e-48e9-910d-ca60ca6a02ef tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:51.514142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6548503d-7d6e-48e9-910d-ca60ca6a02ef tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:51.518194 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=100 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:51.635159 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-42ddd1ff-310c-46b8-bbd6-8129ebf369d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:51.636636 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-42ddd1ff-310c-46b8-bbd6-8129ebf369d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:51.644077 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-42ddd1ff-310c-46b8-bbd6-8129ebf369d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:51.644913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-42ddd1ff-310c-46b8-bbd6-8129ebf369d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:51.646362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-42ddd1ff-310c-46b8-bbd6-8129ebf369d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:51.647015 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-42ddd1ff-310c-46b8-bbd6-8129ebf369d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:51.661608 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6548503d-7d6e-48e9-910d-ca60ca6a02ef tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:51.680115 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6548503d-7d6e-48e9-910d-ca60ca6a02ef tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 0.179624 Jun 16 21:13:51.683496 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 60/128] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:51 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:51.883971 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-42ddd1ff-310c-46b8-bbd6-8129ebf369d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:51.892798 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-42ddd1ff-310c-46b8-bbd6-8129ebf369d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.262016 Jun 16 21:13:51.893624 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 69/129] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:51 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:51.935985 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1aa1442f-d9ce-4402-b280-75b894d76872 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:51.937292 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1aa1442f-d9ce-4402-b280-75b894d76872 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:51.943859 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1aa1442f-d9ce-4402-b280-75b894d76872 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:51.944954 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1aa1442f-d9ce-4402-b280-75b894d76872 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:51.946039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1aa1442f-d9ce-4402-b280-75b894d76872 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:51.946539 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1aa1442f-d9ce-4402-b280-75b894d76872 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:52.128861 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1aa1442f-d9ce-4402-b280-75b894d76872 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:52.142772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1aa1442f-d9ce-4402-b280-75b894d76872 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:52.144588 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1aa1442f-d9ce-4402-b280-75b894d76872 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:52.145714 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1aa1442f-d9ce-4402-b280-75b894d76872 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.214041 Jun 16 21:13:52.146474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 61/130] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:51 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:52.447220 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-2b30aff7-8960-4ddd-b8c1-a990a9edb06c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:52.447827 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-2b30aff7-8960-4ddd-b8c1-a990a9edb06c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:52.460806 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2b30aff7-8960-4ddd-b8c1-a990a9edb06c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:52.461758 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2b30aff7-8960-4ddd-b8c1-a990a9edb06c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:52.462798 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2b30aff7-8960-4ddd-b8c1-a990a9edb06c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:52.463422 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2b30aff7-8960-4ddd-b8c1-a990a9edb06c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:52.677200 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2b30aff7-8960-4ddd-b8c1-a990a9edb06c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:52.688267 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-2b30aff7-8960-4ddd-b8c1-a990a9edb06c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.245238 Jun 16 21:13:52.689131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 70/131] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:52 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:52.703294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5f8d65c6-ab69-4ae7-b730-674fcddbb82a tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:52.706537 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5f8d65c6-ab69-4ae7-b730-674fcddbb82a tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:52.715753 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5f8d65c6-ab69-4ae7-b730-674fcddbb82a tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:52.716559 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5f8d65c6-ab69-4ae7-b730-674fcddbb82a tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:52.717678 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5f8d65c6-ab69-4ae7-b730-674fcddbb82a tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:52.718301 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5f8d65c6-ab69-4ae7-b730-674fcddbb82a tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:52.875371 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5f8d65c6-ab69-4ae7-b730-674fcddbb82a tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:52.885162 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5f8d65c6-ab69-4ae7-b730-674fcddbb82a tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 0.186054 Jun 16 21:13:52.894499 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 62/132] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:52 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:52.910795 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-50d6393e-d6cb-497b-a726-a18cbfa7d569 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:52.911416 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-50d6393e-d6cb-497b-a726-a18cbfa7d569 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:52.925269 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-50d6393e-d6cb-497b-a726-a18cbfa7d569 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:52.925709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-50d6393e-d6cb-497b-a726-a18cbfa7d569 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:52.926486 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-50d6393e-d6cb-497b-a726-a18cbfa7d569 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:52.926932 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-50d6393e-d6cb-497b-a726-a18cbfa7d569 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:53.173973 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-08c7ac44-c374-4519-ba24-42927ec5fa08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:53.177212 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-50d6393e-d6cb-497b-a726-a18cbfa7d569 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:53.180016 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-08c7ac44-c374-4519-ba24-42927ec5fa08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:53.188099 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-08c7ac44-c374-4519-ba24-42927ec5fa08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:53.188582 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-08c7ac44-c374-4519-ba24-42927ec5fa08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:53.189344 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-08c7ac44-c374-4519-ba24-42927ec5fa08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:53.189804 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-08c7ac44-c374-4519-ba24-42927ec5fa08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:53.199291 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-50d6393e-d6cb-497b-a726-a18cbfa7d569 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.292081 Jun 16 21:13:53.199962 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 71/133] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:52 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:53.392296 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-08c7ac44-c374-4519-ba24-42927ec5fa08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:53.402483 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-08c7ac44-c374-4519-ba24-42927ec5fa08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:53.404349 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-08c7ac44-c374-4519-ba24-42927ec5fa08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:53.405594 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-08c7ac44-c374-4519-ba24-42927ec5fa08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.240158 Jun 16 21:13:53.409537 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 63/134] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:53 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:53.706973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-73f029b8-7071-4a78-b47a-f1653afa52fd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:53.707741 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-73f029b8-7071-4a78-b47a-f1653afa52fd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:53.715154 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-73f029b8-7071-4a78-b47a-f1653afa52fd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:53.715593 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-73f029b8-7071-4a78-b47a-f1653afa52fd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:53.716386 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-73f029b8-7071-4a78-b47a-f1653afa52fd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:53.716817 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-73f029b8-7071-4a78-b47a-f1653afa52fd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:53.857899 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-73f029b8-7071-4a78-b47a-f1653afa52fd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:53.865650 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-73f029b8-7071-4a78-b47a-f1653afa52fd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.162489 Jun 16 21:13:53.866775 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 72/135] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:53 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:53.902917 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-254cd04f-7701-4f79-8962-09ef836312a0 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:53.903547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-254cd04f-7701-4f79-8962-09ef836312a0 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:53.910017 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-254cd04f-7701-4f79-8962-09ef836312a0 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:53.910465 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-254cd04f-7701-4f79-8962-09ef836312a0 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:53.911244 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-254cd04f-7701-4f79-8962-09ef836312a0 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:53.911677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-254cd04f-7701-4f79-8962-09ef836312a0 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:54.057291 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-254cd04f-7701-4f79-8962-09ef836312a0 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:54.067647 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-254cd04f-7701-4f79-8962-09ef836312a0 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 0.168997 Jun 16 21:13:54.068327 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 64/136] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:53 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:54.227244 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1ac38f30-4977-4532-8992-28353d9784e5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:54.227858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1ac38f30-4977-4532-8992-28353d9784e5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:54.234217 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1ac38f30-4977-4532-8992-28353d9784e5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:54.234681 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1ac38f30-4977-4532-8992-28353d9784e5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:54.235771 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1ac38f30-4977-4532-8992-28353d9784e5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:54.236217 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1ac38f30-4977-4532-8992-28353d9784e5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:54.389509 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1ac38f30-4977-4532-8992-28353d9784e5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:54.405586 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1ac38f30-4977-4532-8992-28353d9784e5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.182884 Jun 16 21:13:54.406998 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 73/137] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:54 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:54.428064 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-cdd1eae3-a5d4-49b8-bc87-1bde993ac806 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:54.429175 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-cdd1eae3-a5d4-49b8-bc87-1bde993ac806 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:54.436371 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cdd1eae3-a5d4-49b8-bc87-1bde993ac806 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:54.437111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cdd1eae3-a5d4-49b8-bc87-1bde993ac806 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:54.438258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cdd1eae3-a5d4-49b8-bc87-1bde993ac806 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:54.438982 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cdd1eae3-a5d4-49b8-bc87-1bde993ac806 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:54.653281 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-cdd1eae3-a5d4-49b8-bc87-1bde993ac806 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:54.661996 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-cdd1eae3-a5d4-49b8-bc87-1bde993ac806 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:54.663761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-cdd1eae3-a5d4-49b8-bc87-1bde993ac806 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:54.665350 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-cdd1eae3-a5d4-49b8-bc87-1bde993ac806 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.241344 Jun 16 21:13:54.665903 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 65/138] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:54 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:13:54.886326 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4b841aee-b303-4451-b0d9-bd2505a2c80f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:54.886800 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4b841aee-b303-4451-b0d9-bd2505a2c80f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:54.896916 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b841aee-b303-4451-b0d9-bd2505a2c80f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:54.898212 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b841aee-b303-4451-b0d9-bd2505a2c80f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:54.899009 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b841aee-b303-4451-b0d9-bd2505a2c80f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:54.900359 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b841aee-b303-4451-b0d9-bd2505a2c80f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:55.086308 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2c4d691d-ea69-4399-8461-2bdfdd3ec789 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:55.086934 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2c4d691d-ea69-4399-8461-2bdfdd3ec789 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:55.096412 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2c4d691d-ea69-4399-8461-2bdfdd3ec789 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:55.100087 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2c4d691d-ea69-4399-8461-2bdfdd3ec789 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:55.101267 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2c4d691d-ea69-4399-8461-2bdfdd3ec789 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:55.101979 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2c4d691d-ea69-4399-8461-2bdfdd3ec789 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:55.223436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4b841aee-b303-4451-b0d9-bd2505a2c80f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:55.258503 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4b841aee-b303-4451-b0d9-bd2505a2c80f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.375647 Jun 16 21:13:55.260426 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 74/139] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:54 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:55.293027 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2c4d691d-ea69-4399-8461-2bdfdd3ec789 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:55.303303 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2c4d691d-ea69-4399-8461-2bdfdd3ec789 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 0.221440 Jun 16 21:13:55.305601 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 66/140] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:55 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:55.429153 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0d669754-7ef9-4224-9495-57650182b457 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:55.431146 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0d669754-7ef9-4224-9495-57650182b457 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:55.446538 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0d669754-7ef9-4224-9495-57650182b457 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:55.447993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0d669754-7ef9-4224-9495-57650182b457 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:55.449935 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0d669754-7ef9-4224-9495-57650182b457 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:55.452678 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0d669754-7ef9-4224-9495-57650182b457 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:55.683128 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7d83e4ea-9f9b-4073-ba7e-eaeeefdf9410 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:55.683954 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7d83e4ea-9f9b-4073-ba7e-eaeeefdf9410 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:55.697957 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7d83e4ea-9f9b-4073-ba7e-eaeeefdf9410 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:55.699143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7d83e4ea-9f9b-4073-ba7e-eaeeefdf9410 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:55.701013 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7d83e4ea-9f9b-4073-ba7e-eaeeefdf9410 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:55.712931 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7d83e4ea-9f9b-4073-ba7e-eaeeefdf9410 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:55.851812 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0d669754-7ef9-4224-9495-57650182b457 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:55.866968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0d669754-7ef9-4224-9495-57650182b457 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.444115 Jun 16 21:13:55.869015 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 75/141] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:55 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:56.008584 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-7d83e4ea-9f9b-4073-ba7e-eaeeefdf9410 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:56.021380 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-7d83e4ea-9f9b-4073-ba7e-eaeeefdf9410 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:56.023761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-7d83e4ea-9f9b-4073-ba7e-eaeeefdf9410 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:56.025053 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7d83e4ea-9f9b-4073-ba7e-eaeeefdf9410 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.345900 Jun 16 21:13:56.025614 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 67/142] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:55 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:56.280730 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e0f90632-da4a-4ab4-a227-c9a06c4797d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:56.282267 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e0f90632-da4a-4ab4-a227-c9a06c4797d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:56.291222 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e0f90632-da4a-4ab4-a227-c9a06c4797d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:56.291652 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e0f90632-da4a-4ab4-a227-c9a06c4797d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:56.292669 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e0f90632-da4a-4ab4-a227-c9a06c4797d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:56.294618 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e0f90632-da4a-4ab4-a227-c9a06c4797d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:56.299465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=100 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:56.323364 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-78e63727-9602-4109-9ae5-92989ad00ee8 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:56.324041 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-78e63727-9602-4109-9ae5-92989ad00ee8 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:56.334308 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-78e63727-9602-4109-9ae5-92989ad00ee8 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:56.335095 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-78e63727-9602-4109-9ae5-92989ad00ee8 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:56.336688 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-78e63727-9602-4109-9ae5-92989ad00ee8 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:56.339094 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-78e63727-9602-4109-9ae5-92989ad00ee8 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:56.532332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-78e63727-9602-4109-9ae5-92989ad00ee8 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:56.544394 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-78e63727-9602-4109-9ae5-92989ad00ee8 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1314 microversion: 2.1 time: 0.225967 Jun 16 21:13:56.545379 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 68/143] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:56 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:56.645789 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e0f90632-da4a-4ab4-a227-c9a06c4797d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:56.658748 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e0f90632-da4a-4ab4-a227-c9a06c4797d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.385457 Jun 16 21:13:56.662616 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 76/144] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:56 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:56.682122 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-a44a8451-4c06-43dd-9d43-70722ffdded7 req-83e8aae9-eef5-45c5-8e41-bb2202970fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2281b8c3-ec1f-478b-bd50-128d5cf67a04", "name": "network-vif-plugged", "status": "completed", "tag": "6473309c-d2e4-42b4-94b1-6b373a5e59f2"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:13:56.691911 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-a44a8451-4c06-43dd-9d43-70722ffdded7 req-83e8aae9-eef5-45c5-8e41-bb2202970fe8 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:56.696957 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-a44a8451-4c06-43dd-9d43-70722ffdded7 req-83e8aae9-eef5-45c5-8e41-bb2202970fe8 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:56.725694 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-a44a8451-4c06-43dd-9d43-70722ffdded7 req-83e8aae9-eef5-45c5-8e41-bb2202970fe8 service nova] Creating event network-vif-plugged:6473309c-d2e4-42b4-94b1-6b373a5e59f2 for instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 on hv-cinder-81914 Jun 16 21:13:56.737346 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-a44a8451-4c06-43dd-9d43-70722ffdded7 req-83e8aae9-eef5-45c5-8e41-bb2202970fe8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059313 Jun 16 21:13:56.739460 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 69/145] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:13:56.905548 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-da40c6c0-7656-4d8f-bbea-245bd81d9bde tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:56.906579 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-da40c6c0-7656-4d8f-bbea-245bd81d9bde tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:56.917851 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-da40c6c0-7656-4d8f-bbea-245bd81d9bde tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:56.920594 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-da40c6c0-7656-4d8f-bbea-245bd81d9bde tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:56.921603 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-da40c6c0-7656-4d8f-bbea-245bd81d9bde tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:56.922323 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-da40c6c0-7656-4d8f-bbea-245bd81d9bde tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:57.048670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c1e0544a-a61a-4b41-b444-89ecd6efecf6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:57.049804 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c1e0544a-a61a-4b41-b444-89ecd6efecf6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:57.072151 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c1e0544a-a61a-4b41-b444-89ecd6efecf6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:57.072635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c1e0544a-a61a-4b41-b444-89ecd6efecf6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:57.080669 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c1e0544a-a61a-4b41-b444-89ecd6efecf6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:57.081174 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c1e0544a-a61a-4b41-b444-89ecd6efecf6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:57.330394 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-da40c6c0-7656-4d8f-bbea-245bd81d9bde tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:57.338585 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-da40c6c0-7656-4d8f-bbea-245bd81d9bde tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.451049 Jun 16 21:13:57.343051 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 77/146] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:56 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:57.506340 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c1e0544a-a61a-4b41-b444-89ecd6efecf6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:57.519100 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c1e0544a-a61a-4b41-b444-89ecd6efecf6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:57.520660 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c1e0544a-a61a-4b41-b444-89ecd6efecf6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:57.521812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c1e0544a-a61a-4b41-b444-89ecd6efecf6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.482444 Jun 16 21:13:57.522906 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 70/147] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:57 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:13:57.564595 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-2450d7ff-8ba6-4921-8998-492494494af9 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:57.566125 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-2450d7ff-8ba6-4921-8998-492494494af9 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:57.580867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2450d7ff-8ba6-4921-8998-492494494af9 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:57.581536 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2450d7ff-8ba6-4921-8998-492494494af9 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:57.610801 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2450d7ff-8ba6-4921-8998-492494494af9 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:57.617594 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2450d7ff-8ba6-4921-8998-492494494af9 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:57.686440 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2e381b82-d4ec-4c85-b8e0-319e6bcac8cd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:57.687514 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2e381b82-d4ec-4c85-b8e0-319e6bcac8cd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:57.696167 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e381b82-d4ec-4c85-b8e0-319e6bcac8cd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:57.696998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e381b82-d4ec-4c85-b8e0-319e6bcac8cd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:57.697836 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e381b82-d4ec-4c85-b8e0-319e6bcac8cd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:57.698384 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e381b82-d4ec-4c85-b8e0-319e6bcac8cd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:57.975824 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2e381b82-d4ec-4c85-b8e0-319e6bcac8cd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:57.985700 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2e381b82-d4ec-4c85-b8e0-319e6bcac8cd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.313286 Jun 16 21:13:57.995494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 71/148] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:57 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:13:58.169119 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2450d7ff-8ba6-4921-8998-492494494af9 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:58.181691 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-2450d7ff-8ba6-4921-8998-492494494af9 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1501 microversion: 2.1 time: 0.623484 Jun 16 21:13:58.183248 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 78/149] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:57 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1501 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:58.361143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0508b1e1-8b30-4692-873a-121965d33eb8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:58.362171 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0508b1e1-8b30-4692-873a-121965d33eb8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:58.372863 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0508b1e1-8b30-4692-873a-121965d33eb8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:58.373309 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0508b1e1-8b30-4692-873a-121965d33eb8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:58.374445 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0508b1e1-8b30-4692-873a-121965d33eb8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:58.375226 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0508b1e1-8b30-4692-873a-121965d33eb8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:58.549698 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-2b52198c-9cae-453b-9a69-3858e519593d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:58.554070 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-2b52198c-9cae-453b-9a69-3858e519593d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:58.581420 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2b52198c-9cae-453b-9a69-3858e519593d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:58.582483 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2b52198c-9cae-453b-9a69-3858e519593d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:58.583575 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2b52198c-9cae-453b-9a69-3858e519593d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:58.586566 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2b52198c-9cae-453b-9a69-3858e519593d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:58.588953 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0508b1e1-8b30-4692-873a-121965d33eb8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:58.621513 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0508b1e1-8b30-4692-873a-121965d33eb8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.266368 Jun 16 21:13:58.624943 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 72/150] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:58 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:13:58.799098 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-926006d6-4cf8-4d41-98cb-482e095f568e req-6b3a877d-589f-4515-888e-35e61dc52cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397f70d9-d52e-42e2-9d9c-a5921d7632a0", "name": "network-vif-plugged", "status": "completed", "tag": "b0b64745-4342-4163-bc5d-724401da0c19"}, {"server_uuid": "499ae55d-60f9-480c-9ecd-794a1cee0da5", "name": "network-vif-plugged", "status": "completed", "tag": "49dfc0a9-3807-4075-a9a7-5f2dceb98537"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:13:58.832740 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-926006d6-4cf8-4d41-98cb-482e095f568e req-6b3a877d-589f-4515-888e-35e61dc52cd8 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:58.835750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-926006d6-4cf8-4d41-98cb-482e095f568e req-6b3a877d-589f-4515-888e-35e61dc52cd8 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:58.894228 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-926006d6-4cf8-4d41-98cb-482e095f568e req-6b3a877d-589f-4515-888e-35e61dc52cd8 service nova] Creating event network-vif-plugged:b0b64745-4342-4163-bc5d-724401da0c19 for instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 on hv-cinder-81914 Jun 16 21:13:58.896492 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-926006d6-4cf8-4d41-98cb-482e095f568e req-6b3a877d-589f-4515-888e-35e61dc52cd8 service nova] Creating event network-vif-plugged:49dfc0a9-3807-4075-a9a7-5f2dceb98537 for instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 on hv-cinder-81914 Jun 16 21:13:58.921408 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2b52198c-9cae-453b-9a69-3858e519593d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:58.927697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-926006d6-4cf8-4d41-98cb-482e095f568e req-6b3a877d-589f-4515-888e-35e61dc52cd8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.132195 Jun 16 21:13:58.933806 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2b52198c-9cae-453b-9a69-3858e519593d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:58.938906 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 73/151] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:13:58.942063 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2b52198c-9cae-453b-9a69-3858e519593d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:13:58.943234 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-2b52198c-9cae-453b-9a69-3858e519593d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1406 microversion: 2.20 time: 0.400759 Jun 16 21:13:58.945918 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 79/152] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:13:58 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1406 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:13:59.005043 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-f1033e28-58a6-4ec4-92a5-6a4c30f0e548 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:59.006156 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-f1033e28-58a6-4ec4-92a5-6a4c30f0e548 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:59.036888 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f1033e28-58a6-4ec4-92a5-6a4c30f0e548 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:59.037714 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f1033e28-58a6-4ec4-92a5-6a4c30f0e548 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:59.043465 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f1033e28-58a6-4ec4-92a5-6a4c30f0e548 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:59.061517 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f1033e28-58a6-4ec4-92a5-6a4c30f0e548 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:59.642701 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9231663f-22ff-4f9f-9614-d8b1bd97ba9f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:13:59.643320 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-9231663f-22ff-4f9f-9614-d8b1bd97ba9f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:13:59.659793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9231663f-22ff-4f9f-9614-d8b1bd97ba9f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:59.660327 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9231663f-22ff-4f9f-9614-d8b1bd97ba9f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:59.665060 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9231663f-22ff-4f9f-9614-d8b1bd97ba9f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:13:59.671293 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9231663f-22ff-4f9f-9614-d8b1bd97ba9f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:13:59.997361 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9231663f-22ff-4f9f-9614-d8b1bd97ba9f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:00.011803 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9231663f-22ff-4f9f-9614-d8b1bd97ba9f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.372329 Jun 16 21:14:00.015144 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 80/153] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:59 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:00.023899 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e9f33099-2b9e-40a0-81fd-96b09312ec11 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:00.025524 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e9f33099-2b9e-40a0-81fd-96b09312ec11 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:00.035764 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e9f33099-2b9e-40a0-81fd-96b09312ec11 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:00.036433 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e9f33099-2b9e-40a0-81fd-96b09312ec11 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:00.037777 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e9f33099-2b9e-40a0-81fd-96b09312ec11 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:00.039070 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e9f33099-2b9e-40a0-81fd-96b09312ec11 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:00.304925 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e9f33099-2b9e-40a0-81fd-96b09312ec11 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:00.313693 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e9f33099-2b9e-40a0-81fd-96b09312ec11 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:00.316310 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e9f33099-2b9e-40a0-81fd-96b09312ec11 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:00.317908 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e9f33099-2b9e-40a0-81fd-96b09312ec11 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1597 microversion: 2.20 time: 0.301715 Jun 16 21:14:00.318686 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 81/154] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:14:00 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1597 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:14:00.333472 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-f1033e28-58a6-4ec4-92a5-6a4c30f0e548 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:00.339660 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-f1033e28-58a6-4ec4-92a5-6a4c30f0e548 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 1.340634 Jun 16 21:14:00.340461 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 74/155] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:13:58 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:00.341234 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-3ac7f382-8250-458f-8892-0498722d7a1c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "807540d9-b3fa-4c19-9289-3ef23ae03161"}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:00.342635 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-3ac7f382-8250-458f-8892-0498722d7a1c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:00.349142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-04727c79-2bd6-48b6-8809-b758f8e30e51 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:00.349989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3ac7f382-8250-458f-8892-0498722d7a1c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:00.351534 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3ac7f382-8250-458f-8892-0498722d7a1c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:00.353001 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-04727c79-2bd6-48b6-8809-b758f8e30e51 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:00.353498 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3ac7f382-8250-458f-8892-0498722d7a1c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:00.353975 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3ac7f382-8250-458f-8892-0498722d7a1c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:00.365962 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04727c79-2bd6-48b6-8809-b758f8e30e51 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:00.366948 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04727c79-2bd6-48b6-8809-b758f8e30e51 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:00.367914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04727c79-2bd6-48b6-8809-b758f8e30e51 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:00.368419 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04727c79-2bd6-48b6-8809-b758f8e30e51 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:00.597213 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-04727c79-2bd6-48b6-8809-b758f8e30e51 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.255829 Jun 16 21:14:00.598695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 75/156] 10.222.0.43 () {60 vars in 1315 bytes} [Thu Jun 16 21:14:00 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-interface => generated 284 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:14:01.035084 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-aba941bb-5895-41b0-b714-a962071488c0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:01.042276 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-aba941bb-5895-41b0-b714-a962071488c0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:01.055989 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-aba941bb-5895-41b0-b714-a962071488c0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:01.056502 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-aba941bb-5895-41b0-b714-a962071488c0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:01.057680 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-aba941bb-5895-41b0-b714-a962071488c0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:01.058294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-aba941bb-5895-41b0-b714-a962071488c0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:01.161946 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-3ac7f382-8250-458f-8892-0498722d7a1c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "POST /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840002 Jun 16 21:14:01.162562 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 82/157] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 16 21:14:00 2022] POST /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a/os-volume_attachments => generated 194 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:14:01.358236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-77f8bfd5-a3b4-4364-b9b6-ca65f7d7fd81 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:01.359301 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-77f8bfd5-a3b4-4364-b9b6-ca65f7d7fd81 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:01.386982 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-77f8bfd5-a3b4-4364-b9b6-ca65f7d7fd81 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:01.388386 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-77f8bfd5-a3b4-4364-b9b6-ca65f7d7fd81 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:01.390004 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-77f8bfd5-a3b4-4364-b9b6-ca65f7d7fd81 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:01.393137 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-77f8bfd5-a3b4-4364-b9b6-ca65f7d7fd81 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:01.617812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-aba941bb-5895-41b0-b714-a962071488c0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:01.629690 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-aba941bb-5895-41b0-b714-a962071488c0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.600245 Jun 16 21:14:01.630290 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 76/158] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:01 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:02.097895 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-77f8bfd5-a3b4-4364-b9b6-ca65f7d7fd81 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:02.106765 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-77f8bfd5-a3b4-4364-b9b6-ca65f7d7fd81 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.752728 Jun 16 21:14:02.116795 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 83/159] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:01 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:02.647707 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-00c7e4dd-ba23-47b1-8735-08dbe3fc19f2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:02.649343 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-00c7e4dd-ba23-47b1-8735-08dbe3fc19f2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:02.674998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-00c7e4dd-ba23-47b1-8735-08dbe3fc19f2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:02.675544 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-00c7e4dd-ba23-47b1-8735-08dbe3fc19f2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:02.676843 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-00c7e4dd-ba23-47b1-8735-08dbe3fc19f2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:02.678131 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-00c7e4dd-ba23-47b1-8735-08dbe3fc19f2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:02.982010 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-00c7e4dd-ba23-47b1-8735-08dbe3fc19f2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:02.992667 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-00c7e4dd-ba23-47b1-8735-08dbe3fc19f2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.348549 Jun 16 21:14:02.993592 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 77/160] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:02 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:03.127772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-07ec616c-9234-46cb-b4cf-257851ca6bde tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:03.128541 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-07ec616c-9234-46cb-b4cf-257851ca6bde tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:03.128841 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e640c598-9dde-4236-9474-9de65940b0d7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Action: 'create', calling method: .version_select at 0x7fb3fc276a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-423531232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBJO/lpUeMe2q8z1d5T+/ob6hGfuHorPcxPIoX/6R4Gi5AwmyjkNKCPNzgiavkylwK5AYxXWbd++j5KrNB7ACgPIhIjcu6I0S04aY5Oo8EYmA8W/LMmQaRJuCV1f16B5A=="}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:03.135633 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-07ec616c-9234-46cb-b4cf-257851ca6bde tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:03.136227 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-07ec616c-9234-46cb-b4cf-257851ca6bde tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:03.137093 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-07ec616c-9234-46cb-b4cf-257851ca6bde tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:03.137625 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-07ec616c-9234-46cb-b4cf-257851ca6bde tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:03.146128 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-e640c598-9dde-4236-9474-9de65940b0d7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Getting quotas for project 9868add8c6114cc2a3933d63b2e5652a. Resources: {'key_pairs'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:14:03.150583 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-e640c598-9dde-4236-9474-9de65940b0d7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Getting quotas for user 850e2609986546f68540aec652d1cd9f and project 9868add8c6114cc2a3933d63b2e5652a. Resources: {'key_pairs'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:14:03.158012 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=100 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:03.180763 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e640c598-9dde-4236-9474-9de65940b0d7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.434940 Jun 16 21:14:03.181541 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 84/161] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 16 21:14:02 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:14:03.187153 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-3a3c75b0-32c8-47c0-a48c-1dad0937df7d req-fe8c4db5-f973-4652-8c69-083285fccd85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2281b8c3-ec1f-478b-bd50-128d5cf67a04", "tag": "6473309c-d2e4-42b4-94b1-6b373a5e59f2"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:03.196668 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-3a3c75b0-32c8-47c0-a48c-1dad0937df7d req-fe8c4db5-f973-4652-8c69-083285fccd85 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:03.197313 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-3a3c75b0-32c8-47c0-a48c-1dad0937df7d req-fe8c4db5-f973-4652-8c69-083285fccd85 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:03.209909 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-3a3c75b0-32c8-47c0-a48c-1dad0937df7d req-fe8c4db5-f973-4652-8c69-083285fccd85 service nova] Creating event network-changed:6473309c-d2e4-42b4-94b1-6b373a5e59f2 for instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 on hv-cinder-81914 Jun 16 21:14:03.216160 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-3a3c75b0-32c8-47c0-a48c-1dad0937df7d req-fe8c4db5-f973-4652-8c69-083285fccd85 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033061 Jun 16 21:14:03.217076 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 85/162] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:14:03.301020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-07ec616c-9234-46cb-b4cf-257851ca6bde tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:03.313220 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-07ec616c-9234-46cb-b4cf-257851ca6bde tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.192392 Jun 16 21:14:03.316137 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 78/163] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:03 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:04.010688 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-63196717-1047-4c9b-815f-39499b636afb tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:04.011749 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-63196717-1047-4c9b-815f-39499b636afb tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:04.033239 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-63196717-1047-4c9b-815f-39499b636afb tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:04.039767 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-63196717-1047-4c9b-815f-39499b636afb tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:04.040866 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-63196717-1047-4c9b-815f-39499b636afb tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:04.042451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-63196717-1047-4c9b-815f-39499b636afb tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:04.271150 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-63196717-1047-4c9b-815f-39499b636afb tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:04.284089 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-63196717-1047-4c9b-815f-39499b636afb tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1363 microversion: 2.1 time: 0.275393 Jun 16 21:14:04.285266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 86/164] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:04 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:04.334062 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a82db6de-1de1-46c2-b62c-5604fd797f1d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:04.334677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a82db6de-1de1-46c2-b62c-5604fd797f1d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:04.342159 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a82db6de-1de1-46c2-b62c-5604fd797f1d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:04.342901 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a82db6de-1de1-46c2-b62c-5604fd797f1d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:04.344047 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a82db6de-1de1-46c2-b62c-5604fd797f1d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:04.344762 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a82db6de-1de1-46c2-b62c-5604fd797f1d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:04.514400 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a82db6de-1de1-46c2-b62c-5604fd797f1d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:04.524723 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a82db6de-1de1-46c2-b62c-5604fd797f1d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.195535 Jun 16 21:14:04.525819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 79/165] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:04 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:05.301364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-3aa23f2f-eb02-47f2-9dd7-1155eeaa428f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:05.302084 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-3aa23f2f-eb02-47f2-9dd7-1155eeaa428f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:05.315846 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3aa23f2f-eb02-47f2-9dd7-1155eeaa428f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:05.316364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3aa23f2f-eb02-47f2-9dd7-1155eeaa428f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:05.317147 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3aa23f2f-eb02-47f2-9dd7-1155eeaa428f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:05.317569 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3aa23f2f-eb02-47f2-9dd7-1155eeaa428f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:05.542913 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-62c46504-bc95-4650-a82e-0cdc85ce8f09 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:05.543481 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-62c46504-bc95-4650-a82e-0cdc85ce8f09 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:05.554347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-62c46504-bc95-4650-a82e-0cdc85ce8f09 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:05.558256 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-62c46504-bc95-4650-a82e-0cdc85ce8f09 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:05.559116 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-62c46504-bc95-4650-a82e-0cdc85ce8f09 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:05.559549 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-62c46504-bc95-4650-a82e-0cdc85ce8f09 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:05.687942 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3aa23f2f-eb02-47f2-9dd7-1155eeaa428f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:05.699019 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-3aa23f2f-eb02-47f2-9dd7-1155eeaa428f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1548 microversion: 2.1 time: 0.401587 Jun 16 21:14:05.700531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 87/166] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:05 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1548 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:05.719603 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a7a35263-2ba4-4fbb-950b-695786f8d71e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:05.722850 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a7a35263-2ba4-4fbb-950b-695786f8d71e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:05.737052 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a7a35263-2ba4-4fbb-950b-695786f8d71e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:05.740379 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a7a35263-2ba4-4fbb-950b-695786f8d71e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:05.742342 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a7a35263-2ba4-4fbb-950b-695786f8d71e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:05.746896 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a7a35263-2ba4-4fbb-950b-695786f8d71e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:05.915232 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a7a35263-2ba4-4fbb-950b-695786f8d71e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.200639 Jun 16 21:14:05.915830 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 88/167] 10.222.0.43 () {58 vars in 1274 bytes} [Thu Jun 16 21:14:05 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/os-interface => generated 284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:14:05.982644 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-62c46504-bc95-4650-a82e-0cdc85ce8f09 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:05.999940 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-62c46504-bc95-4650-a82e-0cdc85ce8f09 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1367 microversion: 2.1 time: 0.461708 Jun 16 21:14:06.000856 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 80/168] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:05 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1367 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:14:07.020603 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-827dbd2d-4f95-46d3-a418-05289f923112 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:07.024292 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-827dbd2d-4f95-46d3-a418-05289f923112 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:07.027408 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:07.041873 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-827dbd2d-4f95-46d3-a418-05289f923112 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:07.042463 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-827dbd2d-4f95-46d3-a418-05289f923112 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:07.043240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-827dbd2d-4f95-46d3-a418-05289f923112 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:07.043685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-827dbd2d-4f95-46d3-a418-05289f923112 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:07.212077 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-827dbd2d-4f95-46d3-a418-05289f923112 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:07.222180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-827dbd2d-4f95-46d3-a418-05289f923112 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1557 microversion: 2.1 time: 0.207420 Jun 16 21:14:07.224249 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 89/169] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:07 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1557 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:07.243683 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7c0ab1c3-5e57-4213-b199-862b9547417b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:07.244971 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7c0ab1c3-5e57-4213-b199-862b9547417b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:07.252582 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=81 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:07.254779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7c0ab1c3-5e57-4213-b199-862b9547417b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:07.255227 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7c0ab1c3-5e57-4213-b199-862b9547417b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:07.256000 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7c0ab1c3-5e57-4213-b199-862b9547417b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:07.256792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7c0ab1c3-5e57-4213-b199-862b9547417b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:07.468364 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7c0ab1c3-5e57-4213-b199-862b9547417b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.229066 Jun 16 21:14:07.469193 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 81/170] 10.222.0.43 () {58 vars in 1274 bytes} [Thu Jun 16 21:14:07 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0/os-interface => generated 284 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:14:08.955874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-9e5b8e71-f1c8-482a-8803-72f8ac48c13d req-60125fe7-5ffd-43c7-80e1-c4754c4226c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "499ae55d-60f9-480c-9ecd-794a1cee0da5", "tag": "49dfc0a9-3807-4075-a9a7-5f2dceb98537"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:08.969726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-9e5b8e71-f1c8-482a-8803-72f8ac48c13d req-60125fe7-5ffd-43c7-80e1-c4754c4226c4 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:08.970499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-9e5b8e71-f1c8-482a-8803-72f8ac48c13d req-60125fe7-5ffd-43c7-80e1-c4754c4226c4 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:08.984312 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-9e5b8e71-f1c8-482a-8803-72f8ac48c13d req-60125fe7-5ffd-43c7-80e1-c4754c4226c4 service nova] Creating event network-changed:49dfc0a9-3807-4075-a9a7-5f2dceb98537 for instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 on hv-cinder-81914 Jun 16 21:14:08.991136 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-9e5b8e71-f1c8-482a-8803-72f8ac48c13d req-60125fe7-5ffd-43c7-80e1-c4754c4226c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039830 Jun 16 21:14:08.992720 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 90/171] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:14:09.710861 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-e24e23c1-a86e-4ad3-a012-f9e10d05baaa req-1e44dff3-88d1-4340-9ce9-f193df151c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397f70d9-d52e-42e2-9d9c-a5921d7632a0", "tag": "b0b64745-4342-4163-bc5d-724401da0c19"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:09.744082 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-e24e23c1-a86e-4ad3-a012-f9e10d05baaa req-1e44dff3-88d1-4340-9ce9-f193df151c15 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:09.746464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-e24e23c1-a86e-4ad3-a012-f9e10d05baaa req-1e44dff3-88d1-4340-9ce9-f193df151c15 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:09.778583 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-e24e23c1-a86e-4ad3-a012-f9e10d05baaa req-1e44dff3-88d1-4340-9ce9-f193df151c15 service nova] Creating event network-changed:b0b64745-4342-4163-bc5d-724401da0c19 for instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 on hv-cinder-81914 Jun 16 21:14:09.794045 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-e24e23c1-a86e-4ad3-a012-f9e10d05baaa req-1e44dff3-88d1-4340-9ce9-f193df151c15 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095282 Jun 16 21:14:09.796232 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 82/172] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:14:14.205873 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=4 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:14.212554 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-adefaede-c87b-4d2f-be90-f2e037ea087f tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:14.213143 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-adefaede-c87b-4d2f-be90-f2e037ea087f tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:14.220153 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-adefaede-c87b-4d2f-be90-f2e037ea087f tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:14.220829 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-adefaede-c87b-4d2f-be90-f2e037ea087f tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:14.221664 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-adefaede-c87b-4d2f-be90-f2e037ea087f tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:14.222095 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-adefaede-c87b-4d2f-be90-f2e037ea087f tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:14.255828 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-adefaede-c87b-4d2f-be90-f2e037ea087f tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Going to try to terminate instance {{(pid=117737) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:14:14.360694 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-adefaede-c87b-4d2f-be90-f2e037ea087f tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "DELETE /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 204 len: 0 microversion: 2.1 time: 0.155917 Jun 16 21:14:14.361371 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 91/173] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:14:14 2022] DELETE /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:14:14.370990 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d7799599-c691-4f9c-9028-062bea9a9615 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:14.371555 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d7799599-c691-4f9c-9028-062bea9a9615 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:14.378965 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d7799599-c691-4f9c-9028-062bea9a9615 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:14.379419 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d7799599-c691-4f9c-9028-062bea9a9615 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:14.380347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d7799599-c691-4f9c-9028-062bea9a9615 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:14.380954 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d7799599-c691-4f9c-9028-062bea9a9615 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:14.523521 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d7799599-c691-4f9c-9028-062bea9a9615 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:14.531965 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d7799599-c691-4f9c-9028-062bea9a9615 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1553 microversion: 2.1 time: 0.165664 Jun 16 21:14:14.532549 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 83/174] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:14 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:14:15.549695 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-06f463fd-6fed-4891-aae3-b5c92b43f399 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:15.550389 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-06f463fd-6fed-4891-aae3-b5c92b43f399 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:15.557702 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-06f463fd-6fed-4891-aae3-b5c92b43f399 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:15.558142 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-06f463fd-6fed-4891-aae3-b5c92b43f399 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:15.558895 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-06f463fd-6fed-4891-aae3-b5c92b43f399 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:15.559323 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-06f463fd-6fed-4891-aae3-b5c92b43f399 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:15.578593 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:15.704239 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-06f463fd-6fed-4891-aae3-b5c92b43f399 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:15.713587 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-06f463fd-6fed-4891-aae3-b5c92b43f399 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1553 microversion: 2.1 time: 0.168021 Jun 16 21:14:15.714146 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 92/175] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:15 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:16.731594 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-90fa2bec-2fde-4dfd-94a9-7cd10272a814 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:16.733082 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-90fa2bec-2fde-4dfd-94a9-7cd10272a814 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:16.750776 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-90fa2bec-2fde-4dfd-94a9-7cd10272a814 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:16.751465 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-90fa2bec-2fde-4dfd-94a9-7cd10272a814 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:16.752534 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-90fa2bec-2fde-4dfd-94a9-7cd10272a814 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:16.753053 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-90fa2bec-2fde-4dfd-94a9-7cd10272a814 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:16.957505 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-90fa2bec-2fde-4dfd-94a9-7cd10272a814 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:16.966983 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-90fa2bec-2fde-4dfd-94a9-7cd10272a814 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1553 microversion: 2.1 time: 0.239479 Jun 16 21:14:16.976689 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 84/176] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:16 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1553 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:17.567336 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-85f3a98e-d60e-4d15-b0dc-96d48690ba1b req-03f494fe-d241-429a-8815-ee5e6c665ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feac2ab9-4107-4a96-a6b7-07687b5e151a", "name": "network-vif-deleted", "tag": "f058b8da-9aa3-4e1a-b261-fd6763f4e167"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:17.582311 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-85f3a98e-d60e-4d15-b0dc-96d48690ba1b req-03f494fe-d241-429a-8815-ee5e6c665ba6 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:17.582311 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-85f3a98e-d60e-4d15-b0dc-96d48690ba1b req-03f494fe-d241-429a-8815-ee5e6c665ba6 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:17.623635 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-85f3a98e-d60e-4d15-b0dc-96d48690ba1b req-03f494fe-d241-429a-8815-ee5e6c665ba6 service nova] Creating event network-vif-deleted:f058b8da-9aa3-4e1a-b261-fd6763f4e167 for instance feac2ab9-4107-4a96-a6b7-07687b5e151a on hv-cinder-81914 Jun 16 21:14:17.631322 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-85f3a98e-d60e-4d15-b0dc-96d48690ba1b req-03f494fe-d241-429a-8815-ee5e6c665ba6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068262 Jun 16 21:14:17.633978 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 93/177] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:14:17.985719 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-f0e8580d-98cd-4dac-b0ad-a24313d9218c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:17.986341 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-f0e8580d-98cd-4dac-b0ad-a24313d9218c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:18.005029 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f0e8580d-98cd-4dac-b0ad-a24313d9218c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:18.005505 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f0e8580d-98cd-4dac-b0ad-a24313d9218c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:18.006317 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f0e8580d-98cd-4dac-b0ad-a24313d9218c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:18.007293 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f0e8580d-98cd-4dac-b0ad-a24313d9218c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:18.124595 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-f0e8580d-98cd-4dac-b0ad-a24313d9218c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26922cee7b794e0ca8cec43b6f5daff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f4749861b548a6808e215ab16497d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:18.135507 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-f0e8580d-98cd-4dac-b0ad-a24313d9218c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 200 len: 1345 microversion: 2.1 time: 0.154424 Jun 16 21:14:18.136283 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 85/178] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:17 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 1345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:19.155895 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-41b0103c-1cf6-4664-8c8e-a01f2a0c7e0c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:19.156745 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-41b0103c-1cf6-4664-8c8e-a01f2a0c7e0c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:19.163149 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-41b0103c-1cf6-4664-8c8e-a01f2a0c7e0c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:19.163765 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-41b0103c-1cf6-4664-8c8e-a01f2a0c7e0c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:19.164334 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-41b0103c-1cf6-4664-8c8e-a01f2a0c7e0c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:19.164759 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-41b0103c-1cf6-4664-8c8e-a01f2a0c7e0c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:19.179919 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-41b0103c-1cf6-4664-8c8e-a01f2a0c7e0c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] HTTP exception thrown: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-41b0103c-1cf6-4664-8c8e-a01f2a0c7e0c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Request method failure captured: Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a HTTP/1.1 Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5zqAIYO2hRroObq4AamqQvTiO_5Ucm79LictbEOdvU8JZDYE-Wd23cdLUQFdLPhHkjHGwenJN92eDqBr9AUz504MjNVTwM0g4eGsbD859JYfBumgu6800qZWn6vOAC3wVg3BKMlErLo5XagK2Q5bvz45ZWA9Wi_Ss19GdLnBa4KnG4 Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 87f4749861b548a6808e215ab16497d9 Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-DeleteServersTestJSON-987102149 Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:14:19.184989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:14:19.186516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/87f4749861b548a6808e215ab16497d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_87f4749861b548a6808e215ab16497d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/87f4749861b548a6808e215ab16497d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/87f4749861b548a6808e215ab16497d9"}]}] Jun 16 21:14:19.186516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-DeleteServersTestJSON-987102149 Jun 16 21:14:19.186516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 87f4749861b548a6808e215ab16497d9 Jun 16 21:14:19.186516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-DeleteServersTestJSON-987102149 Jun 16 21:14:19.186516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-DeleteServersTestJSON-987102149-project Jun 16 21:14:19.186516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:14:19.186516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:14:19.186516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 26922cee7b794e0ca8cec43b6f5daff2 Jun 16 21:14:19.186516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-DeleteServersTestJSON-987102149-project Jun 16 21:14:19.186516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:14:19.186516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:19.186516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': 'feac2ab9-4107-4a96-a6b7-07687b5e151a'} Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:14:19.187315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:19.188726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:14:19.189956 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-41b0103c-1cf6-4664-8c8e-a01f2a0c7e0c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Returning 404 to user: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:14:19.189956 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-41b0103c-1cf6-4664-8c8e-a01f2a0c7e0c tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 404 len: 111 microversion: 2.1 time: 0.036923 Jun 16 21:14:19.189956 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 94/179] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:19 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 21:14:19.320055 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3d2cc10c-1743-4e11-94cc-2d48e5eb1e47 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:19.321879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-3d2cc10c-1743-4e11-94cc-2d48e5eb1e47 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:19.328057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3d2cc10c-1743-4e11-94cc-2d48e5eb1e47 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:19.328720 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3d2cc10c-1743-4e11-94cc-2d48e5eb1e47 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:19.329676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3d2cc10c-1743-4e11-94cc-2d48e5eb1e47 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:19.330263 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3d2cc10c-1743-4e11-94cc-2d48e5eb1e47 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:19.344899 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-3d2cc10c-1743-4e11-94cc-2d48e5eb1e47 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] HTTP exception thrown: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3d2cc10c-1743-4e11-94cc-2d48e5eb1e47 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Request method failure captured: Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a/os-volume_attachments HTTP/1.1 Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq5zqAIYO2hRroObq4AamqQvTiO_5Ucm79LictbEOdvU8JZDYE-Wd23cdLUQFdLPhHkjHGwenJN92eDqBr9AUz504MjNVTwM0g4eGsbD859JYfBumgu6800qZWn6vOAC3wVg3BKMlErLo5XagK2Q5bvz45ZWA9Wi_Ss19GdLnBa4KnG4 Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 87f4749861b548a6808e215ab16497d9 Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-DeleteServersTestJSON-987102149 Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:14:19.349551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:14:19.351741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/87f4749861b548a6808e215ab16497d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_87f4749861b548a6808e215ab16497d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/87f4749861b548a6808e215ab16497d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/87f4749861b548a6808e215ab16497d9"}]}] Jun 16 21:14:19.351741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-DeleteServersTestJSON-987102149 Jun 16 21:14:19.351741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 87f4749861b548a6808e215ab16497d9 Jun 16 21:14:19.351741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-DeleteServersTestJSON-987102149 Jun 16 21:14:19.351741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-DeleteServersTestJSON-987102149-project Jun 16 21:14:19.351741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:14:19.351741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:14:19.351741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 26922cee7b794e0ca8cec43b6f5daff2 Jun 16 21:14:19.351741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-DeleteServersTestJSON-987102149-project Jun 16 21:14:19.351741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:14:19.351741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:19.351741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'server_id': 'feac2ab9-4107-4a96-a6b7-07687b5e151a'} Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:14:19.352580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:19.354204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:14:19.355514 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3d2cc10c-1743-4e11-94cc-2d48e5eb1e47 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Returning 404 to user: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:14:19.355514 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-3d2cc10c-1743-4e11-94cc-2d48e5eb1e47 tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035661 Jun 16 21:14:19.355514 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 86/180] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:14:19 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:14:22.686487 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c0e7dccb-e38a-4e8b-8409-6effebb02a4b tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:22.687616 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c0e7dccb-e38a-4e8b-8409-6effebb02a4b tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:22.696488 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c0e7dccb-e38a-4e8b-8409-6effebb02a4b tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:22.697009 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c0e7dccb-e38a-4e8b-8409-6effebb02a4b tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:22.697840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c0e7dccb-e38a-4e8b-8409-6effebb02a4b tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:22.698343 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c0e7dccb-e38a-4e8b-8409-6effebb02a4b tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:22.722556 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-c0e7dccb-e38a-4e8b-8409-6effebb02a4b tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] HTTP exception thrown: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c0e7dccb-e38a-4e8b-8409-6effebb02a4b tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Request method failure captured: Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: DELETE /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a HTTP/1.1 Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5zqAIYO2hRroObq4AamqQvTiO_5Ucm79LictbEOdvU8JZDYE-Wd23cdLUQFdLPhHkjHGwenJN92eDqBr9AUz504MjNVTwM0g4eGsbD859JYfBumgu6800qZWn6vOAC3wVg3BKMlErLo5XagK2Q5bvz45ZWA9Wi_Ss19GdLnBa4KnG4 Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 87f4749861b548a6808e215ab16497d9 Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-DeleteServersTestJSON-987102149 Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:14:22.724331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:14:22.726364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/87f4749861b548a6808e215ab16497d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_87f4749861b548a6808e215ab16497d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/87f4749861b548a6808e215ab16497d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/87f4749861b548a6808e215ab16497d9"}]}] Jun 16 21:14:22.726364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-DeleteServersTestJSON-987102149 Jun 16 21:14:22.726364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 87f4749861b548a6808e215ab16497d9 Jun 16 21:14:22.726364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-DeleteServersTestJSON-987102149 Jun 16 21:14:22.726364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-DeleteServersTestJSON-987102149-project Jun 16 21:14:22.726364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:14:22.726364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:14:22.726364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 26922cee7b794e0ca8cec43b6f5daff2 Jun 16 21:14:22.726364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-DeleteServersTestJSON-987102149-project Jun 16 21:14:22.726364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:14:22.726364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:22.726364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': 'feac2ab9-4107-4a96-a6b7-07687b5e151a'} Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:14:22.727107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:22.728429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:14:22.730745 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c0e7dccb-e38a-4e8b-8409-6effebb02a4b tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Returning 404 to user: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:14:22.732315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c0e7dccb-e38a-4e8b-8409-6effebb02a4b tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "DELETE /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 404 len: 111 microversion: 2.1 time: 0.050604 Jun 16 21:14:22.734223 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 95/181] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:14:22 2022] DELETE /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:14:22.746512 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-25b7296d-8bac-43dc-8295-5caf3dbb5abf tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:22.747609 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-25b7296d-8bac-43dc-8295-5caf3dbb5abf tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] [instance: feac2ab9-4107-4a96-a6b7-07687b5e151a] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:22.758583 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-25b7296d-8bac-43dc-8295-5caf3dbb5abf tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:22.759582 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-25b7296d-8bac-43dc-8295-5caf3dbb5abf tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:22.760951 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-25b7296d-8bac-43dc-8295-5caf3dbb5abf tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:22.761855 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-25b7296d-8bac-43dc-8295-5caf3dbb5abf tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-25b7296d-8bac-43dc-8295-5caf3dbb5abf tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] HTTP exception thrown: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-25b7296d-8bac-43dc-8295-5caf3dbb5abf tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Request method failure captured: Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a HTTP/1.1 Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq5zqAIYO2hRroObq4AamqQvTiO_5Ucm79LictbEOdvU8JZDYE-Wd23cdLUQFdLPhHkjHGwenJN92eDqBr9AUz504MjNVTwM0g4eGsbD859JYfBumgu6800qZWn6vOAC3wVg3BKMlErLo5XagK2Q5bvz45ZWA9Wi_Ss19GdLnBa4KnG4 Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 87f4749861b548a6808e215ab16497d9 Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-DeleteServersTestJSON-987102149 Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:14:22.787914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:14:22.789487 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/87f4749861b548a6808e215ab16497d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_87f4749861b548a6808e215ab16497d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/87f4749861b548a6808e215ab16497d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/87f4749861b548a6808e215ab16497d9"}]}] Jun 16 21:14:22.789487 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-DeleteServersTestJSON-987102149 Jun 16 21:14:22.789487 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 87f4749861b548a6808e215ab16497d9 Jun 16 21:14:22.789487 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-DeleteServersTestJSON-987102149 Jun 16 21:14:22.789487 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-DeleteServersTestJSON-987102149-project Jun 16 21:14:22.789487 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:14:22.789487 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:14:22.789487 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 26922cee7b794e0ca8cec43b6f5daff2 Jun 16 21:14:22.789487 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-DeleteServersTestJSON-987102149-project Jun 16 21:14:22.789487 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:14:22.789487 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:22.789487 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': 'feac2ab9-4107-4a96-a6b7-07687b5e151a'} Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:14:22.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. Jun 16 21:14:22.791573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:14:22.797484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-25b7296d-8bac-43dc-8295-5caf3dbb5abf tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] Returning 404 to user: Instance feac2ab9-4107-4a96-a6b7-07687b5e151a could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:14:22.797484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-25b7296d-8bac-43dc-8295-5caf3dbb5abf tempest-DeleteServersTestJSON-987102149 tempest-DeleteServersTestJSON-987102149-project] 10.222.0.43 "GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a" status: 404 len: 111 microversion: 2.1 time: 0.048466 Jun 16 21:14:22.797484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 87/182] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:22 2022] GET /compute/v2.1/servers/feac2ab9-4107-4a96-a6b7-07687b5e151a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:14:23.414636 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ee313fce-a2aa-4c52-983e-66e56b78a464 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1971769424", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452", "networks": [{"uuid": "6ff692fa-20d5-4084-a00f-6e1d9f9d60b1"}]}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:23.468104 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.network.neutron [None req-ee313fce-a2aa-4c52-983e-66e56b78a464 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] validate_networks() for [('6ff692fa-20d5-4084-a00f-6e1d9f9d60b1', None, None, None, None, None)] {{(pid=117737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:14:24.176680 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-ee313fce-a2aa-4c52-983e-66e56b78a464 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Flavor limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:14:24.177720 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-ee313fce-a2aa-4c52-983e-66e56b78a464 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Image limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:14:24.178201 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-ee313fce-a2aa-4c52-983e-66e56b78a464 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Flavor pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:14:24.178685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-ee313fce-a2aa-4c52-983e-66e56b78a464 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Image pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:14:24.179365 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-ee313fce-a2aa-4c52-983e-66e56b78a464 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:14:24.189342 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ee313fce-a2aa-4c52-983e-66e56b78a464 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:24.189761 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ee313fce-a2aa-4c52-983e-66e56b78a464 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:24.190590 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ee313fce-a2aa-4c52-983e-66e56b78a464 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:24.191111 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ee313fce-a2aa-4c52-983e-66e56b78a464 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:24.223130 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-ee313fce-a2aa-4c52-983e-66e56b78a464 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Getting quotas for project 0a667c6d13514cc4bdaaf4598bc723d4. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:14:24.232047 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-ee313fce-a2aa-4c52-983e-66e56b78a464 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Getting quotas for user 2d1d69a29709455d9d9dc596ecbb870d and project 0a667c6d13514cc4bdaaf4598bc723d4. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:14:24.253547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ee313fce-a2aa-4c52-983e-66e56b78a464 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Going to run 1 instances... {{(pid=117737) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:14:24.259489 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ee313fce-a2aa-4c52-983e-66e56b78a464 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:14:24.321227 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ee313fce-a2aa-4c52-983e-66e56b78a464 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.910149 Jun 16 21:14:24.322186 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 96/183] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:14:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:14:24.331773 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-70e8454e-0d52-4f30-b4f1-201c813a1ef7 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:24.332468 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-70e8454e-0d52-4f30-b4f1-201c813a1ef7 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:24.409891 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-70e8454e-0d52-4f30-b4f1-201c813a1ef7 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:24.421207 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-70e8454e-0d52-4f30-b4f1-201c813a1ef7 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1219 microversion: 2.1 time: 0.093201 Jun 16 21:14:24.433157 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 88/184] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:24 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:25.438583 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7c5ed579-c9c3-4641-a649-9b676a32121c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:25.439176 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7c5ed579-c9c3-4641-a649-9b676a32121c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:25.446584 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7c5ed579-c9c3-4641-a649-9b676a32121c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:25.447398 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7c5ed579-c9c3-4641-a649-9b676a32121c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:25.448442 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7c5ed579-c9c3-4641-a649-9b676a32121c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:25.449094 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7c5ed579-c9c3-4641-a649-9b676a32121c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:25.616420 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7c5ed579-c9c3-4641-a649-9b676a32121c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:25.630752 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7c5ed579-c9c3-4641-a649-9b676a32121c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1271 microversion: 2.1 time: 0.196093 Jun 16 21:14:25.638898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 97/185] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:25 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1271 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:26.655692 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1d078521-fb96-4e95-9887-2ca5d46440d9 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:26.656975 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1d078521-fb96-4e95-9887-2ca5d46440d9 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:26.666004 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1d078521-fb96-4e95-9887-2ca5d46440d9 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:26.666617 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1d078521-fb96-4e95-9887-2ca5d46440d9 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:26.667670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1d078521-fb96-4e95-9887-2ca5d46440d9 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:26.668426 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1d078521-fb96-4e95-9887-2ca5d46440d9 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:26.896486 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a4abed88-5224-4b52-9d07-ae7867f31b11 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-169598719", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-423531232", "security_groups": [{"name": "tempest-secgroup-smoke-1762033399"}], "networks": [{"uuid": "2b4fd2f5-218d-4169-8b25-5af8eae424cf"}], "block_device_mapping_v2": [{"uuid": "c87dfd8d-bba8-47fd-9a9e-d42878dbbbea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:27.229695 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.network.neutron [None req-a4abed88-5224-4b52-9d07-ae7867f31b11 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] validate_networks() for [('2b4fd2f5-218d-4169-8b25-5af8eae424cf', None, None, None, None, None)] {{(pid=117737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:14:27.570207 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1d078521-fb96-4e95-9887-2ca5d46440d9 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:27.580692 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1d078521-fb96-4e95-9887-2ca5d46440d9 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1319 microversion: 2.1 time: 0.929767 Jun 16 21:14:27.582267 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 89/186] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:26 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1319 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:28.242312 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-a4abed88-5224-4b52-9d07-ae7867f31b11 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Flavor limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:14:28.242812 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-a4abed88-5224-4b52-9d07-ae7867f31b11 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Image limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:14:28.243293 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-a4abed88-5224-4b52-9d07-ae7867f31b11 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Flavor pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:14:28.243783 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-a4abed88-5224-4b52-9d07-ae7867f31b11 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Image pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:14:28.244299 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-a4abed88-5224-4b52-9d07-ae7867f31b11 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:14:28.256160 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a4abed88-5224-4b52-9d07-ae7867f31b11 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:28.258517 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a4abed88-5224-4b52-9d07-ae7867f31b11 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:28.260852 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a4abed88-5224-4b52-9d07-ae7867f31b11 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:28.261428 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a4abed88-5224-4b52-9d07-ae7867f31b11 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:28.291493 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-b724f4c4-0020-4863-b263-6450093cdeb1 req-98c51641-0b80-42b5-9058-6fed1603965e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1203965c-d902-4af7-99a1-308d7d5a6159", "tag": "6f8829ec-9941-48af-93e2-a733042b82bb"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:28.311260 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-a4abed88-5224-4b52-9d07-ae7867f31b11 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Getting quotas for project 9868add8c6114cc2a3933d63b2e5652a. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:14:28.315024 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-b724f4c4-0020-4863-b263-6450093cdeb1 req-98c51641-0b80-42b5-9058-6fed1603965e service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:28.317310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-b724f4c4-0020-4863-b263-6450093cdeb1 req-98c51641-0b80-42b5-9058-6fed1603965e service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:28.322945 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-a4abed88-5224-4b52-9d07-ae7867f31b11 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Getting quotas for user 850e2609986546f68540aec652d1cd9f and project 9868add8c6114cc2a3933d63b2e5652a. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:14:28.342277 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-b724f4c4-0020-4863-b263-6450093cdeb1 req-98c51641-0b80-42b5-9058-6fed1603965e service nova] Creating event network-changed:6f8829ec-9941-48af-93e2-a733042b82bb for instance 1203965c-d902-4af7-99a1-308d7d5a6159 on hv-cinder-81914 Jun 16 21:14:28.353923 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-b724f4c4-0020-4863-b263-6450093cdeb1 req-98c51641-0b80-42b5-9058-6fed1603965e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068330 Jun 16 21:14:28.354650 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 90/187] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:14:28.437669 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a4abed88-5224-4b52-9d07-ae7867f31b11 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Going to run 1 instances... {{(pid=117737) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:14:28.439676 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a4abed88-5224-4b52-9d07-ae7867f31b11 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c87dfd8d-bba8-47fd-9a9e-d42878dbbbea',volume_size=None,volume_type=None)] {{(pid=117737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:14:28.618613 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-623f84f7-1095-449b-8646-200ec71beaed tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:28.619333 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-623f84f7-1095-449b-8646-200ec71beaed tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:28.634531 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-623f84f7-1095-449b-8646-200ec71beaed tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:28.635081 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-623f84f7-1095-449b-8646-200ec71beaed tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:28.639556 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-623f84f7-1095-449b-8646-200ec71beaed tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:28.640451 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-623f84f7-1095-449b-8646-200ec71beaed tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:28.687398 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a4abed88-5224-4b52-9d07-ae7867f31b11 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.800480 Jun 16 21:14:28.697074 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 98/188] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:14:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:14:28.707316 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1299f733-f32d-4b46-8bd8-acf6112f3622 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:28.708966 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1299f733-f32d-4b46-8bd8-acf6112f3622 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:28.839007 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1299f733-f32d-4b46-8bd8-acf6112f3622 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:28.854832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1299f733-f32d-4b46-8bd8-acf6112f3622 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1087 microversion: 2.1 time: 0.155590 Jun 16 21:14:28.855432 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 99/189] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:28 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1087 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:14:28.989910 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-623f84f7-1095-449b-8646-200ec71beaed tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:29.010153 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-623f84f7-1095-449b-8646-200ec71beaed tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1319 microversion: 2.1 time: 0.394959 Jun 16 21:14:29.012416 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 91/190] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:28 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:29.878998 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e4027b43-ac2a-42d1-a9a3-62d0f9a9a7c1 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:29.879611 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e4027b43-ac2a-42d1-a9a3-62d0f9a9a7c1 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:29.886944 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e4027b43-ac2a-42d1-a9a3-62d0f9a9a7c1 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:29.887388 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e4027b43-ac2a-42d1-a9a3-62d0f9a9a7c1 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:29.888378 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e4027b43-ac2a-42d1-a9a3-62d0f9a9a7c1 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:29.888807 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e4027b43-ac2a-42d1-a9a3-62d0f9a9a7c1 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:29.978139 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e4027b43-ac2a-42d1-a9a3-62d0f9a9a7c1 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:29.988739 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e4027b43-ac2a-42d1-a9a3-62d0f9a9a7c1 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1137 microversion: 2.1 time: 0.113369 Jun 16 21:14:29.989606 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 100/191] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:29 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1137 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:30.030459 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1afcec97-6102-4c75-893b-4ddf6265c19a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:30.031067 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1afcec97-6102-4c75-893b-4ddf6265c19a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:30.038781 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1afcec97-6102-4c75-893b-4ddf6265c19a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:30.038972 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1afcec97-6102-4c75-893b-4ddf6265c19a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:30.039921 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1afcec97-6102-4c75-893b-4ddf6265c19a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:30.040717 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1afcec97-6102-4c75-893b-4ddf6265c19a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:30.271268 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1afcec97-6102-4c75-893b-4ddf6265c19a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:30.279339 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1afcec97-6102-4c75-893b-4ddf6265c19a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1319 microversion: 2.1 time: 0.252862 Jun 16 21:14:30.288966 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 92/192] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:30 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:31.007699 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e0d77659-33cf-43d8-b1fa-9a22947ecef1 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:31.013542 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e0d77659-33cf-43d8-b1fa-9a22947ecef1 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:31.036977 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e0d77659-33cf-43d8-b1fa-9a22947ecef1 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:31.038716 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e0d77659-33cf-43d8-b1fa-9a22947ecef1 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:31.043238 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e0d77659-33cf-43d8-b1fa-9a22947ecef1 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:31.044019 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e0d77659-33cf-43d8-b1fa-9a22947ecef1 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:31.297722 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6badbb11-3376-4619-ad26-07cfb6156417 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:31.298343 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6badbb11-3376-4619-ad26-07cfb6156417 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:31.313416 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6badbb11-3376-4619-ad26-07cfb6156417 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:31.315374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6badbb11-3376-4619-ad26-07cfb6156417 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:31.318438 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6badbb11-3376-4619-ad26-07cfb6156417 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:31.319785 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6badbb11-3376-4619-ad26-07cfb6156417 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:31.321105 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e0d77659-33cf-43d8-b1fa-9a22947ecef1 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:31.332205 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e0d77659-33cf-43d8-b1fa-9a22947ecef1 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1203 microversion: 2.1 time: 0.329983 Jun 16 21:14:31.332718 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 101/193] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:31 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1203 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:31.652164 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6badbb11-3376-4619-ad26-07cfb6156417 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:31.682416 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6badbb11-3376-4619-ad26-07cfb6156417 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1319 microversion: 2.1 time: 0.388268 Jun 16 21:14:31.687757 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 93/194] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:31 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:32.358211 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-dcc903a0-1da0-4bd9-bef9-0667af34067f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:32.359437 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-dcc903a0-1da0-4bd9-bef9-0667af34067f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:32.373919 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dcc903a0-1da0-4bd9-bef9-0667af34067f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:32.375465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dcc903a0-1da0-4bd9-bef9-0667af34067f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:32.376599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dcc903a0-1da0-4bd9-bef9-0667af34067f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:32.377195 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dcc903a0-1da0-4bd9-bef9-0667af34067f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:32.705265 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7372499e-3632-4ed2-b221-8370753156d3 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:32.706845 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7372499e-3632-4ed2-b221-8370753156d3 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:32.715974 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7372499e-3632-4ed2-b221-8370753156d3 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:32.716669 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7372499e-3632-4ed2-b221-8370753156d3 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:32.718354 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7372499e-3632-4ed2-b221-8370753156d3 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:32.720754 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7372499e-3632-4ed2-b221-8370753156d3 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:32.750455 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-dcc903a0-1da0-4bd9-bef9-0667af34067f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:32.763918 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-dcc903a0-1da0-4bd9-bef9-0667af34067f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1259 microversion: 2.1 time: 0.415408 Jun 16 21:14:32.773837 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 102/195] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:32 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1259 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:33.033365 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-7372499e-3632-4ed2-b221-8370753156d3 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:33.050900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7372499e-3632-4ed2-b221-8370753156d3 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1319 microversion: 2.1 time: 0.349305 Jun 16 21:14:33.052503 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 94/196] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:32 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:33.255255 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-b4bc7ccb-27fb-4ef5-9fb9-df243d507656 req-f0fe9779-35bd-44fb-b902-1065669185e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "329313fc-d559-41c6-9dad-471e57c9751e", "tag": "dbb3b245-c7c5-45cc-8bc9-e46efbfd90bb"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:33.269972 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-b4bc7ccb-27fb-4ef5-9fb9-df243d507656 req-f0fe9779-35bd-44fb-b902-1065669185e8 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:33.270421 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-b4bc7ccb-27fb-4ef5-9fb9-df243d507656 req-f0fe9779-35bd-44fb-b902-1065669185e8 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:33.293926 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-b4bc7ccb-27fb-4ef5-9fb9-df243d507656 req-f0fe9779-35bd-44fb-b902-1065669185e8 service nova] Creating event network-changed:dbb3b245-c7c5-45cc-8bc9-e46efbfd90bb for instance 329313fc-d559-41c6-9dad-471e57c9751e on hv-cinder-81914 Jun 16 21:14:33.318460 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-b4bc7ccb-27fb-4ef5-9fb9-df243d507656 req-f0fe9779-35bd-44fb-b902-1065669185e8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066763 Jun 16 21:14:33.326503 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 103/197] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:14:33.781007 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1325502f-6c3d-4f24-9213-bde666438036 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:33.781697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1325502f-6c3d-4f24-9213-bde666438036 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:33.788392 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1325502f-6c3d-4f24-9213-bde666438036 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:33.788891 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1325502f-6c3d-4f24-9213-bde666438036 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:33.789705 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1325502f-6c3d-4f24-9213-bde666438036 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:33.790379 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1325502f-6c3d-4f24-9213-bde666438036 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:33.794104 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=75 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:33.962351 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1325502f-6c3d-4f24-9213-bde666438036 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:33.979580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1325502f-6c3d-4f24-9213-bde666438036 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1259 microversion: 2.1 time: 0.202397 Jun 16 21:14:33.980168 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 95/198] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:33 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:34.071324 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ba1fb6c5-0cda-40f0-9f50-734d8aff3d37 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:34.072218 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ba1fb6c5-0cda-40f0-9f50-734d8aff3d37 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:34.080070 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ba1fb6c5-0cda-40f0-9f50-734d8aff3d37 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:34.080862 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ba1fb6c5-0cda-40f0-9f50-734d8aff3d37 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:34.082225 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ba1fb6c5-0cda-40f0-9f50-734d8aff3d37 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:34.083123 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ba1fb6c5-0cda-40f0-9f50-734d8aff3d37 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:34.411713 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-ba1fb6c5-0cda-40f0-9f50-734d8aff3d37 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:34.422333 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ba1fb6c5-0cda-40f0-9f50-734d8aff3d37 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1319 microversion: 2.1 time: 0.355758 Jun 16 21:14:34.425007 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 104/199] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:34 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:34.999759 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6c1f14de-5402-4eab-8246-5241015eafed tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:35.000528 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6c1f14de-5402-4eab-8246-5241015eafed tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:35.003949 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=2 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:35.009516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6c1f14de-5402-4eab-8246-5241015eafed tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:35.010244 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6c1f14de-5402-4eab-8246-5241015eafed tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:35.011096 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6c1f14de-5402-4eab-8246-5241015eafed tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:35.011613 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6c1f14de-5402-4eab-8246-5241015eafed tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:35.221580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6c1f14de-5402-4eab-8246-5241015eafed tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:35.230976 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6c1f14de-5402-4eab-8246-5241015eafed tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1259 microversion: 2.1 time: 0.237137 Jun 16 21:14:35.232660 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 96/200] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:34 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:35.439732 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4c21073d-c391-4e71-bea8-6b1aded9798b tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:35.441274 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4c21073d-c391-4e71-bea8-6b1aded9798b tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:35.458860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4c21073d-c391-4e71-bea8-6b1aded9798b tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:35.463783 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4c21073d-c391-4e71-bea8-6b1aded9798b tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:35.469336 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4c21073d-c391-4e71-bea8-6b1aded9798b tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:35.470048 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4c21073d-c391-4e71-bea8-6b1aded9798b tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:35.643562 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4c21073d-c391-4e71-bea8-6b1aded9798b tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:35.652050 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4c21073d-c391-4e71-bea8-6b1aded9798b tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1319 microversion: 2.1 time: 0.216980 Jun 16 21:14:35.652941 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 105/201] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:35 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:35.792784 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-edfdfcf7-cd26-4907-a637-fe954caa1ade tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1706671080", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:35.848472 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.network.neutron [None req-edfdfcf7-cd26-4907-a637-fe954caa1ade tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] validate_networks() for [('a845e201-b1f1-498f-803f-02b706e2fd26', None, None, None, None, None)] {{(pid=117738) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:14:36.186632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-66b113d2-a1e0-4e71-902a-51cfff81c8a0 req-61bd08c1-87e1-4fe1-a254-32abd0356322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1203965c-d902-4af7-99a1-308d7d5a6159", "name": "network-vif-plugged", "status": "completed", "tag": "6f8829ec-9941-48af-93e2-a733042b82bb"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:36.203327 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-66b113d2-a1e0-4e71-902a-51cfff81c8a0 req-61bd08c1-87e1-4fe1-a254-32abd0356322 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:36.204084 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-66b113d2-a1e0-4e71-902a-51cfff81c8a0 req-61bd08c1-87e1-4fe1-a254-32abd0356322 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:36.218822 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-66b113d2-a1e0-4e71-902a-51cfff81c8a0 req-61bd08c1-87e1-4fe1-a254-32abd0356322 service nova] Creating event network-vif-plugged:6f8829ec-9941-48af-93e2-a733042b82bb for instance 1203965c-d902-4af7-99a1-308d7d5a6159 on hv-cinder-81914 Jun 16 21:14:36.224378 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-66b113d2-a1e0-4e71-902a-51cfff81c8a0 req-61bd08c1-87e1-4fe1-a254-32abd0356322 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043287 Jun 16 21:14:36.225611 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 106/202] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:14:36.251453 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5feb5fd6-5ce5-4541-b0fd-e6363210de94 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:36.252484 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5feb5fd6-5ce5-4541-b0fd-e6363210de94 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:36.260025 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5feb5fd6-5ce5-4541-b0fd-e6363210de94 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:36.260988 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5feb5fd6-5ce5-4541-b0fd-e6363210de94 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:36.261985 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5feb5fd6-5ce5-4541-b0fd-e6363210de94 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:36.262667 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5feb5fd6-5ce5-4541-b0fd-e6363210de94 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:36.515636 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5feb5fd6-5ce5-4541-b0fd-e6363210de94 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:36.524039 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5feb5fd6-5ce5-4541-b0fd-e6363210de94 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1259 microversion: 2.1 time: 0.277648 Jun 16 21:14:36.524659 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 107/203] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:36 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1259 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:14:36.669349 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-6e8eefb1-2304-4815-a0e3-dd4aa8171385 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:36.670257 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-6e8eefb1-2304-4815-a0e3-dd4aa8171385 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:36.677767 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6e8eefb1-2304-4815-a0e3-dd4aa8171385 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:36.678214 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6e8eefb1-2304-4815-a0e3-dd4aa8171385 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:36.679491 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6e8eefb1-2304-4815-a0e3-dd4aa8171385 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:36.680188 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6e8eefb1-2304-4815-a0e3-dd4aa8171385 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:36.835236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6e8eefb1-2304-4815-a0e3-dd4aa8171385 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:36.845978 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-6e8eefb1-2304-4815-a0e3-dd4aa8171385 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1319 microversion: 2.1 time: 0.181210 Jun 16 21:14:36.846594 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 108/204] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:36 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:14:37.064445 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-edfdfcf7-cd26-4907-a637-fe954caa1ade tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Flavor limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:14:37.065511 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-edfdfcf7-cd26-4907-a637-fe954caa1ade tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Image limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:14:37.066111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-edfdfcf7-cd26-4907-a637-fe954caa1ade tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Flavor pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:14:37.066708 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-edfdfcf7-cd26-4907-a637-fe954caa1ade tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Image pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:14:37.067116 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-edfdfcf7-cd26-4907-a637-fe954caa1ade tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:14:37.077927 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-edfdfcf7-cd26-4907-a637-fe954caa1ade tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:37.082450 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-edfdfcf7-cd26-4907-a637-fe954caa1ade tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:37.083403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-edfdfcf7-cd26-4907-a637-fe954caa1ade tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:37.083821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-edfdfcf7-cd26-4907-a637-fe954caa1ade tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:37.107533 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-edfdfcf7-cd26-4907-a637-fe954caa1ade tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Getting quotas for project 6b341c2d77764f3890f2501cfc6945a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:14:37.111800 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-edfdfcf7-cd26-4907-a637-fe954caa1ade tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Getting quotas for user 1d410832e6584828875128e31baa0ae8 and project 6b341c2d77764f3890f2501cfc6945a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:14:37.128039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-edfdfcf7-cd26-4907-a637-fe954caa1ade tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Going to run 1 instances... {{(pid=117738) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:14:37.130343 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-edfdfcf7-cd26-4907-a637-fe954caa1ade tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:14:37.191072 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-edfdfcf7-cd26-4907-a637-fe954caa1ade tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.524828 Jun 16 21:14:37.192357 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 97/205] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:14:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 1527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 21:14:37.202572 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-69d6ea06-feb1-4f71-9950-5b8b0892ccef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:37.203405 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-69d6ea06-feb1-4f71-9950-5b8b0892ccef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:37.209486 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:37.332544 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-69d6ea06-feb1-4f71-9950-5b8b0892ccef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:37.344068 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-69d6ea06-feb1-4f71-9950-5b8b0892ccef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1222 microversion: 2.1 time: 0.145428 Jun 16 21:14:37.358489 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 109/206] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:37 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1222 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:37.442077 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7b85e943-f441-42a3-8503-1025151506ef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1225392458", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:37.463446 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:37.540916 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.network.neutron [None req-7b85e943-f441-42a3-8503-1025151506ef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] validate_networks() for [('a845e201-b1f1-498f-803f-02b706e2fd26', None, None, None, None, None)] {{(pid=117738) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:14:37.541872 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-61311742-9525-4772-8161-42cd13bc1137 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:37.542489 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-61311742-9525-4772-8161-42cd13bc1137 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:37.552820 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-61311742-9525-4772-8161-42cd13bc1137 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:37.563982 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-61311742-9525-4772-8161-42cd13bc1137 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:37.566404 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-61311742-9525-4772-8161-42cd13bc1137 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:37.567224 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-61311742-9525-4772-8161-42cd13bc1137 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:37.776156 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-61311742-9525-4772-8161-42cd13bc1137 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:37.794162 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-61311742-9525-4772-8161-42cd13bc1137 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1259 microversion: 2.1 time: 0.257104 Jun 16 21:14:37.794743 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 110/207] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:37 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1259 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:37.863283 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-3db5c09b-dc25-4406-91c3-9d3a39f7f537 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:37.864316 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-3db5c09b-dc25-4406-91c3-9d3a39f7f537 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:37.871403 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3db5c09b-dc25-4406-91c3-9d3a39f7f537 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:37.872198 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3db5c09b-dc25-4406-91c3-9d3a39f7f537 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:37.873184 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3db5c09b-dc25-4406-91c3-9d3a39f7f537 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:37.873826 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3db5c09b-dc25-4406-91c3-9d3a39f7f537 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:38.161007 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-7b85e943-f441-42a3-8503-1025151506ef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Flavor limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:14:38.162043 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-7b85e943-f441-42a3-8503-1025151506ef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Image limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:14:38.162767 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-7b85e943-f441-42a3-8503-1025151506ef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Flavor pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:14:38.163470 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-7b85e943-f441-42a3-8503-1025151506ef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Image pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:14:38.164103 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-7b85e943-f441-42a3-8503-1025151506ef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:14:38.173599 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7b85e943-f441-42a3-8503-1025151506ef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:38.174305 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7b85e943-f441-42a3-8503-1025151506ef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:38.175321 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7b85e943-f441-42a3-8503-1025151506ef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:38.175991 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7b85e943-f441-42a3-8503-1025151506ef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:38.196690 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-7b85e943-f441-42a3-8503-1025151506ef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Getting quotas for project 6b341c2d77764f3890f2501cfc6945a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:14:38.200983 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-7b85e943-f441-42a3-8503-1025151506ef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Getting quotas for user 1d410832e6584828875128e31baa0ae8 and project 6b341c2d77764f3890f2501cfc6945a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:14:38.212892 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7b85e943-f441-42a3-8503-1025151506ef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Going to run 1 instances... {{(pid=117738) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:14:38.215570 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7b85e943-f441-42a3-8503-1025151506ef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:14:38.240747 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3db5c09b-dc25-4406-91c3-9d3a39f7f537 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:38.254679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-3db5c09b-dc25-4406-91c3-9d3a39f7f537 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1319 microversion: 2.1 time: 0.394976 Jun 16 21:14:38.255932 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 111/208] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:37 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:14:38.276824 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7b85e943-f441-42a3-8503-1025151506ef tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.840879 Jun 16 21:14:38.289686 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-bc44ff19-1e05-4746-a2c3-174975132489 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:38.290645 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-bc44ff19-1e05-4746-a2c3-174975132489 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:38.296899 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 98/209] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:14:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:14:38.309036 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=4 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:38.383220 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bc44ff19-1e05-4746-a2c3-174975132489 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:38.393470 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-bc44ff19-1e05-4746-a2c3-174975132489 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1222 microversion: 2.1 time: 0.109255 Jun 16 21:14:38.394954 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 112/210] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:38 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:38.814004 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-71ca37d8-c1df-4db5-8f4c-7ed56d2f6706 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:38.815014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-71ca37d8-c1df-4db5-8f4c-7ed56d2f6706 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:38.825158 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-71ca37d8-c1df-4db5-8f4c-7ed56d2f6706 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:38.825962 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-71ca37d8-c1df-4db5-8f4c-7ed56d2f6706 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:38.827801 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-71ca37d8-c1df-4db5-8f4c-7ed56d2f6706 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:38.828532 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-71ca37d8-c1df-4db5-8f4c-7ed56d2f6706 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:39.022813 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-71ca37d8-c1df-4db5-8f4c-7ed56d2f6706 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:39.033162 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-71ca37d8-c1df-4db5-8f4c-7ed56d2f6706 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1259 microversion: 2.1 time: 0.225017 Jun 16 21:14:39.034598 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 99/211] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:38 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:39.274124 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-717cc480-4648-485a-a5d3-e95ceb0fe067 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:39.274848 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-717cc480-4648-485a-a5d3-e95ceb0fe067 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:39.282631 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-717cc480-4648-485a-a5d3-e95ceb0fe067 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:39.283292 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-717cc480-4648-485a-a5d3-e95ceb0fe067 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:39.284339 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-717cc480-4648-485a-a5d3-e95ceb0fe067 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:39.285059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-717cc480-4648-485a-a5d3-e95ceb0fe067 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:39.416044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-63bc6f40-ef19-4171-81cf-7e1e51786810 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:39.418447 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-63bc6f40-ef19-4171-81cf-7e1e51786810 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:39.431964 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-63bc6f40-ef19-4171-81cf-7e1e51786810 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:39.433228 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-63bc6f40-ef19-4171-81cf-7e1e51786810 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:39.434354 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-63bc6f40-ef19-4171-81cf-7e1e51786810 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:39.435008 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-63bc6f40-ef19-4171-81cf-7e1e51786810 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:39.474175 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-717cc480-4648-485a-a5d3-e95ceb0fe067 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:39.485029 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-717cc480-4648-485a-a5d3-e95ceb0fe067 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1508 microversion: 2.1 time: 0.216374 Jun 16 21:14:39.486177 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 113/212] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:39 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:39.566665 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-63bc6f40-ef19-4171-81cf-7e1e51786810 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:39.581402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-63bc6f40-ef19-4171-81cf-7e1e51786810 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1226 microversion: 2.1 time: 0.173341 Jun 16 21:14:39.583683 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 100/213] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:39 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1226 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:40.051548 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4abf859f-2e86-41e4-b2ab-8296cd5a2f31 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:40.052273 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4abf859f-2e86-41e4-b2ab-8296cd5a2f31 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:40.062074 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4abf859f-2e86-41e4-b2ab-8296cd5a2f31 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:40.063587 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4abf859f-2e86-41e4-b2ab-8296cd5a2f31 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:40.064530 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4abf859f-2e86-41e4-b2ab-8296cd5a2f31 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:40.065107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4abf859f-2e86-41e4-b2ab-8296cd5a2f31 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:40.326375 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4abf859f-2e86-41e4-b2ab-8296cd5a2f31 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:40.340996 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4abf859f-2e86-41e4-b2ab-8296cd5a2f31 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1259 microversion: 2.1 time: 0.289179 Jun 16 21:14:40.348535 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 114/214] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:40 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1259 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:40.602299 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-de8408cb-f409-437e-b9b0-f8255551029c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:40.602831 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-de8408cb-f409-437e-b9b0-f8255551029c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:40.615632 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-de8408cb-f409-437e-b9b0-f8255551029c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:40.617329 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-de8408cb-f409-437e-b9b0-f8255551029c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:40.618919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-de8408cb-f409-437e-b9b0-f8255551029c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:40.619548 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-de8408cb-f409-437e-b9b0-f8255551029c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:40.720345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-de8408cb-f409-437e-b9b0-f8255551029c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:40.734334 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-de8408cb-f409-437e-b9b0-f8255551029c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1280 microversion: 2.1 time: 0.137359 Jun 16 21:14:40.735155 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 101/215] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:40 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1280 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:14:41.362037 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-76f99267-7f57-493d-99bd-5523e4de7da7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:41.362648 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-76f99267-7f57-493d-99bd-5523e4de7da7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:41.380504 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-76f99267-7f57-493d-99bd-5523e4de7da7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:41.381205 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-76f99267-7f57-493d-99bd-5523e4de7da7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:41.384253 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-76f99267-7f57-493d-99bd-5523e4de7da7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:41.384949 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-76f99267-7f57-493d-99bd-5523e4de7da7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:41.590742 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-76f99267-7f57-493d-99bd-5523e4de7da7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:41.633306 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-76f99267-7f57-493d-99bd-5523e4de7da7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1259 microversion: 2.1 time: 0.260950 Jun 16 21:14:41.636549 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 115/216] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:41 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1259 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:41.754706 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-725a24f7-c4ef-4996-b6cf-ab2413d27f56 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:41.755900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-725a24f7-c4ef-4996-b6cf-ab2413d27f56 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:41.764146 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-725a24f7-c4ef-4996-b6cf-ab2413d27f56 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:41.764933 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-725a24f7-c4ef-4996-b6cf-ab2413d27f56 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:41.765906 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-725a24f7-c4ef-4996-b6cf-ab2413d27f56 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:41.766328 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-725a24f7-c4ef-4996-b6cf-ab2413d27f56 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:42.129695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-725a24f7-c4ef-4996-b6cf-ab2413d27f56 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:42.141288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-725a24f7-c4ef-4996-b6cf-ab2413d27f56 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1322 microversion: 2.1 time: 0.390253 Jun 16 21:14:42.154767 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 102/217] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:41 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:42.587593 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-d3514c6c-edec-4d7a-9338-421a3cd825c4 req-40053072-ef3a-4225-99d2-fa717b1ebf09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "633275c9-cc8b-4860-b701-2085f7323773", "tag": "362ac5b6-b908-494d-a8dc-1f18ad69384a"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:42.603141 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-d3514c6c-edec-4d7a-9338-421a3cd825c4 req-40053072-ef3a-4225-99d2-fa717b1ebf09 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:42.603505 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-d3514c6c-edec-4d7a-9338-421a3cd825c4 req-40053072-ef3a-4225-99d2-fa717b1ebf09 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:42.633276 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-d3514c6c-edec-4d7a-9338-421a3cd825c4 req-40053072-ef3a-4225-99d2-fa717b1ebf09 service nova] Creating event network-changed:362ac5b6-b908-494d-a8dc-1f18ad69384a for instance 633275c9-cc8b-4860-b701-2085f7323773 on hv-cinder-81914 Jun 16 21:14:42.641343 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-d3514c6c-edec-4d7a-9338-421a3cd825c4 req-40053072-ef3a-4225-99d2-fa717b1ebf09 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058956 Jun 16 21:14:42.645815 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 116/218] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:14:42.651175 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-ff8a36c9-5c04-4297-aa06-09a2ed20812f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:42.652084 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-ff8a36c9-5c04-4297-aa06-09a2ed20812f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:42.660605 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ff8a36c9-5c04-4297-aa06-09a2ed20812f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:42.661449 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ff8a36c9-5c04-4297-aa06-09a2ed20812f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:42.662459 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ff8a36c9-5c04-4297-aa06-09a2ed20812f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:42.664990 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ff8a36c9-5c04-4297-aa06-09a2ed20812f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:43.159381 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-cfdc9e04-a329-476a-b03c-762b7ca029d1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:43.160086 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-cfdc9e04-a329-476a-b03c-762b7ca029d1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:43.170437 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cfdc9e04-a329-476a-b03c-762b7ca029d1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:43.171256 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cfdc9e04-a329-476a-b03c-762b7ca029d1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:43.177880 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cfdc9e04-a329-476a-b03c-762b7ca029d1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:43.179097 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cfdc9e04-a329-476a-b03c-762b7ca029d1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:43.199982 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=100 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:43.292671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-ff8a36c9-5c04-4297-aa06-09a2ed20812f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:43.311050 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-ff8a36c9-5c04-4297-aa06-09a2ed20812f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1259 microversion: 2.1 time: 0.665306 Jun 16 21:14:43.311868 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 103/219] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:42 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1259 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:14:43.364983 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-cfdc9e04-a329-476a-b03c-762b7ca029d1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:43.373823 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-cfdc9e04-a329-476a-b03c-762b7ca029d1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1322 microversion: 2.1 time: 0.218496 Jun 16 21:14:43.375650 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 117/220] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:43 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:14:44.329788 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d09e3f94-5438-4050-a448-1b6c12b1a60a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:44.330387 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d09e3f94-5438-4050-a448-1b6c12b1a60a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:44.340285 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d09e3f94-5438-4050-a448-1b6c12b1a60a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:44.340760 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d09e3f94-5438-4050-a448-1b6c12b1a60a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:44.341544 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d09e3f94-5438-4050-a448-1b6c12b1a60a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:44.341978 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d09e3f94-5438-4050-a448-1b6c12b1a60a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:44.396037 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-807d982c-7b5e-4092-83d1-40b7ee614e8e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:44.396785 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-807d982c-7b5e-4092-83d1-40b7ee614e8e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:44.403409 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-807d982c-7b5e-4092-83d1-40b7ee614e8e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:44.403847 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-807d982c-7b5e-4092-83d1-40b7ee614e8e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:44.404673 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-807d982c-7b5e-4092-83d1-40b7ee614e8e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:44.405100 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-807d982c-7b5e-4092-83d1-40b7ee614e8e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:44.512892 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d09e3f94-5438-4050-a448-1b6c12b1a60a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:44.524715 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d09e3f94-5438-4050-a448-1b6c12b1a60a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1259 microversion: 2.1 time: 0.198651 Jun 16 21:14:44.526002 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 104/221] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:44 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1259 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:44.572704 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-807d982c-7b5e-4092-83d1-40b7ee614e8e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:44.582574 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-807d982c-7b5e-4092-83d1-40b7ee614e8e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1322 microversion: 2.1 time: 0.193395 Jun 16 21:14:44.583064 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 118/222] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:44 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:44.929977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-b212bd43-e247-4b60-a9c2-9f7be51a64da req-f2009d4a-1573-4872-88c8-76150f9a57fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "087f8794-8313-46f9-804b-3d8ac048266b", "tag": "5fc46882-3511-4c90-846e-a7b5cec70e4a"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:44.939078 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-b212bd43-e247-4b60-a9c2-9f7be51a64da req-f2009d4a-1573-4872-88c8-76150f9a57fd service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:44.939502 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-b212bd43-e247-4b60-a9c2-9f7be51a64da req-f2009d4a-1573-4872-88c8-76150f9a57fd service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:44.951641 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-b212bd43-e247-4b60-a9c2-9f7be51a64da req-f2009d4a-1573-4872-88c8-76150f9a57fd service nova] Creating event network-changed:5fc46882-3511-4c90-846e-a7b5cec70e4a for instance 087f8794-8313-46f9-804b-3d8ac048266b on hv-cinder-81914 Jun 16 21:14:44.956979 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-b212bd43-e247-4b60-a9c2-9f7be51a64da req-f2009d4a-1573-4872-88c8-76150f9a57fd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030929 Jun 16 21:14:44.957651 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 105/223] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:14:45.542788 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b6d5ed4d-1337-4393-bb08-9a45dc0ddddf tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:45.544039 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b6d5ed4d-1337-4393-bb08-9a45dc0ddddf tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:45.552880 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b6d5ed4d-1337-4393-bb08-9a45dc0ddddf tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:45.554348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b6d5ed4d-1337-4393-bb08-9a45dc0ddddf tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:45.555865 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b6d5ed4d-1337-4393-bb08-9a45dc0ddddf tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:45.556695 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b6d5ed4d-1337-4393-bb08-9a45dc0ddddf tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:45.601466 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-13c5e176-8e40-4a85-82bb-e8878427d95e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:45.602778 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-13c5e176-8e40-4a85-82bb-e8878427d95e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:45.610543 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-13c5e176-8e40-4a85-82bb-e8878427d95e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:45.611501 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-13c5e176-8e40-4a85-82bb-e8878427d95e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:45.612357 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-13c5e176-8e40-4a85-82bb-e8878427d95e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:45.612947 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-13c5e176-8e40-4a85-82bb-e8878427d95e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:45.736732 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b6d5ed4d-1337-4393-bb08-9a45dc0ddddf tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:45.745083 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b6d5ed4d-1337-4393-bb08-9a45dc0ddddf tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1259 microversion: 2.1 time: 0.206497 Jun 16 21:14:45.745649 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 119/224] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:45 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:45.775045 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-13c5e176-8e40-4a85-82bb-e8878427d95e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:45.782653 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-13c5e176-8e40-4a85-82bb-e8878427d95e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1322 microversion: 2.1 time: 0.185554 Jun 16 21:14:45.783215 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 106/225] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:45 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:14:46.762506 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-506ed098-8a56-40f0-9bfc-81b6cae10df4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:46.763131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-506ed098-8a56-40f0-9bfc-81b6cae10df4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:46.769704 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-506ed098-8a56-40f0-9bfc-81b6cae10df4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:46.770144 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-506ed098-8a56-40f0-9bfc-81b6cae10df4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:46.770901 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-506ed098-8a56-40f0-9bfc-81b6cae10df4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:46.771331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-506ed098-8a56-40f0-9bfc-81b6cae10df4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:46.799575 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-90640078-4555-463b-b93d-7b787d2c1fbf tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:46.800316 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-90640078-4555-463b-b93d-7b787d2c1fbf tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:46.806607 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-90640078-4555-463b-b93d-7b787d2c1fbf tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:46.807064 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-90640078-4555-463b-b93d-7b787d2c1fbf tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:46.807852 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-90640078-4555-463b-b93d-7b787d2c1fbf tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:46.808330 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-90640078-4555-463b-b93d-7b787d2c1fbf tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:46.914832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-506ed098-8a56-40f0-9bfc-81b6cae10df4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:46.922322 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-506ed098-8a56-40f0-9bfc-81b6cae10df4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1259 microversion: 2.1 time: 0.163741 Jun 16 21:14:46.923104 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 120/226] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:46 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:46.946971 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-90640078-4555-463b-b93d-7b787d2c1fbf tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:46.954275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-90640078-4555-463b-b93d-7b787d2c1fbf tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1322 microversion: 2.1 time: 0.158476 Jun 16 21:14:46.954827 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 107/227] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:46 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:14:47.293601 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-88f1a9ce-a6f7-42e2-b1e1-d7b36737b82d req-2b822e90-b341-407c-a5f9-f386bc2ce950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "633275c9-cc8b-4860-b701-2085f7323773", "name": "network-vif-plugged", "status": "completed", "tag": "362ac5b6-b908-494d-a8dc-1f18ad69384a"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:47.302061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-88f1a9ce-a6f7-42e2-b1e1-d7b36737b82d req-2b822e90-b341-407c-a5f9-f386bc2ce950 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:47.302924 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-88f1a9ce-a6f7-42e2-b1e1-d7b36737b82d req-2b822e90-b341-407c-a5f9-f386bc2ce950 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:47.317993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-88f1a9ce-a6f7-42e2-b1e1-d7b36737b82d req-2b822e90-b341-407c-a5f9-f386bc2ce950 service nova] Creating event network-vif-plugged:362ac5b6-b908-494d-a8dc-1f18ad69384a for instance 633275c9-cc8b-4860-b701-2085f7323773 on hv-cinder-81914 Jun 16 21:14:47.324071 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-88f1a9ce-a6f7-42e2-b1e1-d7b36737b82d req-2b822e90-b341-407c-a5f9-f386bc2ce950 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034500 Jun 16 21:14:47.324864 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 121/228] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:14:47.940540 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b8cc6c47-6479-4ca8-8135-cac6c5e94ced tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:47.941234 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b8cc6c47-6479-4ca8-8135-cac6c5e94ced tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:47.947863 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b8cc6c47-6479-4ca8-8135-cac6c5e94ced tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:47.948483 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b8cc6c47-6479-4ca8-8135-cac6c5e94ced tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:47.949286 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b8cc6c47-6479-4ca8-8135-cac6c5e94ced tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:47.949718 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b8cc6c47-6479-4ca8-8135-cac6c5e94ced tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:47.970707 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e2391f8b-946a-4d64-9e06-f515bbecfcb4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:47.971399 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e2391f8b-946a-4d64-9e06-f515bbecfcb4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:47.977909 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e2391f8b-946a-4d64-9e06-f515bbecfcb4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:47.978358 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e2391f8b-946a-4d64-9e06-f515bbecfcb4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:47.979174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e2391f8b-946a-4d64-9e06-f515bbecfcb4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:47.979603 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e2391f8b-946a-4d64-9e06-f515bbecfcb4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:48.122718 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e2391f8b-946a-4d64-9e06-f515bbecfcb4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:48.130700 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e2391f8b-946a-4d64-9e06-f515bbecfcb4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1322 microversion: 2.1 time: 0.164530 Jun 16 21:14:48.131195 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 122/229] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:47 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:14:48.166095 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b8cc6c47-6479-4ca8-8135-cac6c5e94ced tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:48.174186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b8cc6c47-6479-4ca8-8135-cac6c5e94ced tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1259 microversion: 2.1 time: 0.238354 Jun 16 21:14:48.174798 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 108/230] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:47 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:49.148921 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-20b4c0b3-20aa-43c1-b054-2171b10ebf42 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:49.149675 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-20b4c0b3-20aa-43c1-b054-2171b10ebf42 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:49.151860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=18 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:49.158236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-20b4c0b3-20aa-43c1-b054-2171b10ebf42 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:49.158686 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-20b4c0b3-20aa-43c1-b054-2171b10ebf42 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:49.159532 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-20b4c0b3-20aa-43c1-b054-2171b10ebf42 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:49.160008 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-20b4c0b3-20aa-43c1-b054-2171b10ebf42 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:49.191614 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1a2b31e6-b99c-40c5-8dd4-f82aeae2517f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:49.192379 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1a2b31e6-b99c-40c5-8dd4-f82aeae2517f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:49.194428 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=4 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:49.195213 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=12 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:49.201319 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1a2b31e6-b99c-40c5-8dd4-f82aeae2517f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:49.201782 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1a2b31e6-b99c-40c5-8dd4-f82aeae2517f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:49.202715 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1a2b31e6-b99c-40c5-8dd4-f82aeae2517f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:49.203146 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1a2b31e6-b99c-40c5-8dd4-f82aeae2517f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:49.338305 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-20b4c0b3-20aa-43c1-b054-2171b10ebf42 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:49.346945 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-20b4c0b3-20aa-43c1-b054-2171b10ebf42 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1322 microversion: 2.1 time: 0.202416 Jun 16 21:14:49.348354 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 123/231] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:49 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:49.374731 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1a2b31e6-b99c-40c5-8dd4-f82aeae2517f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:49.382700 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1a2b31e6-b99c-40c5-8dd4-f82aeae2517f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1259 microversion: 2.1 time: 0.195541 Jun 16 21:14:49.383502 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 109/232] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:49 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:14:49.491746 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-7acaba16-bfaf-40d4-bf04-f6c2ddf2b2df req-263c16cb-4e0b-496a-8eef-82c740d97eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329313fc-d559-41c6-9dad-471e57c9751e", "name": "network-vif-plugged", "status": "completed", "tag": "dbb3b245-c7c5-45cc-8bc9-e46efbfd90bb"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:49.501708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-7acaba16-bfaf-40d4-bf04-f6c2ddf2b2df req-263c16cb-4e0b-496a-8eef-82c740d97eff service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:49.502465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-7acaba16-bfaf-40d4-bf04-f6c2ddf2b2df req-263c16cb-4e0b-496a-8eef-82c740d97eff service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:49.514267 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-7acaba16-bfaf-40d4-bf04-f6c2ddf2b2df req-263c16cb-4e0b-496a-8eef-82c740d97eff service nova] Creating event network-vif-plugged:dbb3b245-c7c5-45cc-8bc9-e46efbfd90bb for instance 329313fc-d559-41c6-9dad-471e57c9751e on hv-cinder-81914 Jun 16 21:14:49.519204 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-7acaba16-bfaf-40d4-bf04-f6c2ddf2b2df req-263c16cb-4e0b-496a-8eef-82c740d97eff service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031867 Jun 16 21:14:49.519821 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 124/233] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:14:50.367861 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b3ab9313-c4d2-48b7-a25e-0ba05074c1d5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:50.369286 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b3ab9313-c4d2-48b7-a25e-0ba05074c1d5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:50.375617 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b3ab9313-c4d2-48b7-a25e-0ba05074c1d5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:50.376066 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b3ab9313-c4d2-48b7-a25e-0ba05074c1d5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:50.376873 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b3ab9313-c4d2-48b7-a25e-0ba05074c1d5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:50.377310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b3ab9313-c4d2-48b7-a25e-0ba05074c1d5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:50.402727 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-fc5e5078-2006-4981-8eba-ce792381cffb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:50.403425 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-fc5e5078-2006-4981-8eba-ce792381cffb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:50.409543 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fc5e5078-2006-4981-8eba-ce792381cffb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:50.410172 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fc5e5078-2006-4981-8eba-ce792381cffb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:50.410950 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fc5e5078-2006-4981-8eba-ce792381cffb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:50.411384 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fc5e5078-2006-4981-8eba-ce792381cffb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:50.518643 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b3ab9313-c4d2-48b7-a25e-0ba05074c1d5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:50.527479 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b3ab9313-c4d2-48b7-a25e-0ba05074c1d5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1322 microversion: 2.1 time: 0.164084 Jun 16 21:14:50.528097 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 110/234] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:50 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:50.608457 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-fc5e5078-2006-4981-8eba-ce792381cffb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:50.617329 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-fc5e5078-2006-4981-8eba-ce792381cffb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1259 microversion: 2.1 time: 0.219213 Jun 16 21:14:50.617896 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 125/235] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:50 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:14:51.537344 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-3ff3b9bc-a562-422c-b838-79f314d565e4 req-5f27c393-52ef-4e26-b4d3-18a9ed8f0fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087f8794-8313-46f9-804b-3d8ac048266b", "name": "network-vif-plugged", "status": "completed", "tag": "5fc46882-3511-4c90-846e-a7b5cec70e4a"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:51.544368 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-cc7a1dde-7c82-4816-b568-796b09f81ba5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:51.544889 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-cc7a1dde-7c82-4816-b568-796b09f81ba5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:51.547179 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-3ff3b9bc-a562-422c-b838-79f314d565e4 req-5f27c393-52ef-4e26-b4d3-18a9ed8f0fdc service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:51.547625 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-3ff3b9bc-a562-422c-b838-79f314d565e4 req-5f27c393-52ef-4e26-b4d3-18a9ed8f0fdc service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:51.551273 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cc7a1dde-7c82-4816-b568-796b09f81ba5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:51.551877 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cc7a1dde-7c82-4816-b568-796b09f81ba5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:51.552667 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cc7a1dde-7c82-4816-b568-796b09f81ba5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:51.553093 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cc7a1dde-7c82-4816-b568-796b09f81ba5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:51.560827 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-3ff3b9bc-a562-422c-b838-79f314d565e4 req-5f27c393-52ef-4e26-b4d3-18a9ed8f0fdc service nova] Creating event network-vif-plugged:5fc46882-3511-4c90-846e-a7b5cec70e4a for instance 087f8794-8313-46f9-804b-3d8ac048266b on hv-cinder-81914 Jun 16 21:14:51.566069 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-3ff3b9bc-a562-422c-b838-79f314d565e4 req-5f27c393-52ef-4e26-b4d3-18a9ed8f0fdc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034351 Jun 16 21:14:51.566857 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 111/236] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:14:51.634375 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8e8e12ef-decd-4da3-9176-e06f64a2daa4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:51.635149 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8e8e12ef-decd-4da3-9176-e06f64a2daa4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:51.641321 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8e8e12ef-decd-4da3-9176-e06f64a2daa4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:51.644734 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8e8e12ef-decd-4da3-9176-e06f64a2daa4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:51.645562 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8e8e12ef-decd-4da3-9176-e06f64a2daa4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:51.646097 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8e8e12ef-decd-4da3-9176-e06f64a2daa4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:51.704706 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-cc7a1dde-7c82-4816-b568-796b09f81ba5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:51.714268 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-cc7a1dde-7c82-4816-b568-796b09f81ba5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1322 microversion: 2.1 time: 0.173708 Jun 16 21:14:51.714848 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 126/237] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:51 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:51.788888 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8e8e12ef-decd-4da3-9176-e06f64a2daa4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:51.796291 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8e8e12ef-decd-4da3-9176-e06f64a2daa4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1442 microversion: 2.1 time: 0.166942 Jun 16 21:14:51.796860 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 112/238] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:51 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1442 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:14:51.813480 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4b6c1d85-a817-4805-95d3-1216430ea301 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:51.814251 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4b6c1d85-a817-4805-95d3-1216430ea301 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:51.821932 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b6c1d85-a817-4805-95d3-1216430ea301 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:51.822378 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b6c1d85-a817-4805-95d3-1216430ea301 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:51.823139 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b6c1d85-a817-4805-95d3-1216430ea301 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:51.823620 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b6c1d85-a817-4805-95d3-1216430ea301 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:52.024960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4b6c1d85-a817-4805-95d3-1216430ea301 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:52.033067 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4b6c1d85-a817-4805-95d3-1216430ea301 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1442 microversion: 2.1 time: 0.223829 Jun 16 21:14:52.033794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 127/239] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:51 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1442 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:52.730688 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7de90339-37d0-4a9d-b77b-4b95e8f7e5e3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:52.731882 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7de90339-37d0-4a9d-b77b-4b95e8f7e5e3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:52.738247 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7de90339-37d0-4a9d-b77b-4b95e8f7e5e3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:52.738691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7de90339-37d0-4a9d-b77b-4b95e8f7e5e3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:52.739482 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7de90339-37d0-4a9d-b77b-4b95e8f7e5e3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:52.739917 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7de90339-37d0-4a9d-b77b-4b95e8f7e5e3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:52.876430 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-7de90339-37d0-4a9d-b77b-4b95e8f7e5e3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:52.884352 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7de90339-37d0-4a9d-b77b-4b95e8f7e5e3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1322 microversion: 2.1 time: 0.157487 Jun 16 21:14:52.884972 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 113/240] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:52 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:53.898771 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-9a20bb68-c6f0-4175-91ce-c3bd173a3b7b req-61a92af1-efb8-44a6-8e9f-20c299173a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "329313fc-d559-41c6-9dad-471e57c9751e", "tag": "dbb3b245-c7c5-45cc-8bc9-e46efbfd90bb"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:53.901172 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a599844f-57a4-4319-afa7-748b1e11f1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:53.902165 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a599844f-57a4-4319-afa7-748b1e11f1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:53.907555 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-9a20bb68-c6f0-4175-91ce-c3bd173a3b7b req-61a92af1-efb8-44a6-8e9f-20c299173a1d service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:53.908025 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-9a20bb68-c6f0-4175-91ce-c3bd173a3b7b req-61a92af1-efb8-44a6-8e9f-20c299173a1d service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:53.910890 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a599844f-57a4-4319-afa7-748b1e11f1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:53.911338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a599844f-57a4-4319-afa7-748b1e11f1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:53.912115 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a599844f-57a4-4319-afa7-748b1e11f1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:53.912598 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a599844f-57a4-4319-afa7-748b1e11f1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:53.921577 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-9a20bb68-c6f0-4175-91ce-c3bd173a3b7b req-61a92af1-efb8-44a6-8e9f-20c299173a1d service nova] Creating event network-changed:dbb3b245-c7c5-45cc-8bc9-e46efbfd90bb for instance 329313fc-d559-41c6-9dad-471e57c9751e on hv-cinder-81914 Jun 16 21:14:53.926466 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-9a20bb68-c6f0-4175-91ce-c3bd173a3b7b req-61a92af1-efb8-44a6-8e9f-20c299173a1d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034711 Jun 16 21:14:53.927069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 128/241] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:14:53.930769 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=100 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:54.069666 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a599844f-57a4-4319-afa7-748b1e11f1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:54.087056 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a599844f-57a4-4319-afa7-748b1e11f1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1322 microversion: 2.1 time: 0.189441 Jun 16 21:14:54.087382 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 114/242] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:53 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:14:55.108366 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-89df5209-07ce-4eb9-9c22-09e9d0a6954a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:55.109248 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-89df5209-07ce-4eb9-9c22-09e9d0a6954a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:55.115934 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-89df5209-07ce-4eb9-9c22-09e9d0a6954a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:55.117118 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-89df5209-07ce-4eb9-9c22-09e9d0a6954a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:55.117962 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-89df5209-07ce-4eb9-9c22-09e9d0a6954a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:55.118464 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-89df5209-07ce-4eb9-9c22-09e9d0a6954a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:55.257402 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-89df5209-07ce-4eb9-9c22-09e9d0a6954a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:55.265358 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-89df5209-07ce-4eb9-9c22-09e9d0a6954a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1517 microversion: 2.1 time: 0.161663 Jun 16 21:14:55.266013 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 129/243] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:55 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:55.283068 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-195b4d0b-8bf1-46cc-ac80-03d835969599 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:14:55.284018 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-195b4d0b-8bf1-46cc-ac80-03d835969599 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:55.290734 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-195b4d0b-8bf1-46cc-ac80-03d835969599 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:55.291179 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-195b4d0b-8bf1-46cc-ac80-03d835969599 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:55.291943 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-195b4d0b-8bf1-46cc-ac80-03d835969599 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:55.292407 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-195b4d0b-8bf1-46cc-ac80-03d835969599 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:55.313976 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.objects.instance [None req-195b4d0b-8bf1-46cc-ac80-03d835969599 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lazy-loading 'flavor' on Instance uuid 087f8794-8313-46f9-804b-3d8ac048266b {{(pid=117738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:14:55.430072 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-195b4d0b-8bf1-46cc-ac80-03d835969599 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "POST /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b/action" status: 200 len: 32 microversion: 2.1 time: 0.151131 Jun 16 21:14:55.430676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 115/244] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 16 21:14:55 2022] POST /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 21:14:55.439500 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ba0ea87d-9c6d-4fd2-962a-e8c5482e3fd8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:55.440108 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ba0ea87d-9c6d-4fd2-962a-e8c5482e3fd8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:55.446372 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ba0ea87d-9c6d-4fd2-962a-e8c5482e3fd8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:55.446819 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ba0ea87d-9c6d-4fd2-962a-e8c5482e3fd8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:55.447589 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ba0ea87d-9c6d-4fd2-962a-e8c5482e3fd8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:55.448016 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ba0ea87d-9c6d-4fd2-962a-e8c5482e3fd8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:55.588895 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-ba0ea87d-9c6d-4fd2-962a-e8c5482e3fd8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:55.596513 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ba0ea87d-9c6d-4fd2-962a-e8c5482e3fd8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.160749 Jun 16 21:14:55.597070 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 130/245] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:55 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:56.614198 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-37a0c770-f780-4a5b-8ef0-741d19988a7d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:56.614885 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-37a0c770-f780-4a5b-8ef0-741d19988a7d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:56.621755 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-37a0c770-f780-4a5b-8ef0-741d19988a7d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:56.622193 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-37a0c770-f780-4a5b-8ef0-741d19988a7d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:56.622940 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-37a0c770-f780-4a5b-8ef0-741d19988a7d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:56.623441 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-37a0c770-f780-4a5b-8ef0-741d19988a7d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:56.762174 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-37a0c770-f780-4a5b-8ef0-741d19988a7d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:56.770474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-37a0c770-f780-4a5b-8ef0-741d19988a7d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.160723 Jun 16 21:14:56.771338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 116/246] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:56 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:57.471777 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-3fb53ee4-c2e5-452a-9eba-4d88d782dd82 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:57.472338 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-3fb53ee4-c2e5-452a-9eba-4d88d782dd82 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:57.480203 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3fb53ee4-c2e5-452a-9eba-4d88d782dd82 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:57.480663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3fb53ee4-c2e5-452a-9eba-4d88d782dd82 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:57.481421 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3fb53ee4-c2e5-452a-9eba-4d88d782dd82 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:57.481851 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3fb53ee4-c2e5-452a-9eba-4d88d782dd82 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:57.506785 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-3fb53ee4-c2e5-452a-9eba-4d88d782dd82 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/ips" status: 200 len: 150 microversion: 2.20 time: 0.038646 Jun 16 21:14:57.507529 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 131/247] 10.222.0.43 () {60 vars in 1288 bytes} [Thu Jun 16 21:14:57 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:14:57.803864 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-f80baf87-cb18-49aa-8f57-5b81fe337401 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:57.804791 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-f80baf87-cb18-49aa-8f57-5b81fe337401 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:57.817781 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f80baf87-cb18-49aa-8f57-5b81fe337401 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:57.817781 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f80baf87-cb18-49aa-8f57-5b81fe337401 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:57.818215 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f80baf87-cb18-49aa-8f57-5b81fe337401 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:57.818944 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f80baf87-cb18-49aa-8f57-5b81fe337401 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:57.966620 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-f80baf87-cb18-49aa-8f57-5b81fe337401 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:57.974415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-f80baf87-cb18-49aa-8f57-5b81fe337401 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.189976 Jun 16 21:14:57.974971 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 117/248] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:57 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:14:58.991085 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0d767aa9-f2ec-4695-a393-ac1cb773abbc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:14:58.991756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0d767aa9-f2ec-4695-a393-ac1cb773abbc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:14:58.999147 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0d767aa9-f2ec-4695-a393-ac1cb773abbc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:58.999595 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0d767aa9-f2ec-4695-a393-ac1cb773abbc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:59.000392 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0d767aa9-f2ec-4695-a393-ac1cb773abbc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:14:59.000821 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0d767aa9-f2ec-4695-a393-ac1cb773abbc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:14:59.131024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0d767aa9-f2ec-4695-a393-ac1cb773abbc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:14:59.138810 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0d767aa9-f2ec-4695-a393-ac1cb773abbc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.151528 Jun 16 21:14:59.139392 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 132/249] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:14:58 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:00.155607 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-f9290015-3fd6-45dc-86a4-34fa37cf47d6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:00.156227 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-f9290015-3fd6-45dc-86a4-34fa37cf47d6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:00.163198 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f9290015-3fd6-45dc-86a4-34fa37cf47d6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:00.163537 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f9290015-3fd6-45dc-86a4-34fa37cf47d6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:00.164318 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f9290015-3fd6-45dc-86a4-34fa37cf47d6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:00.164742 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f9290015-3fd6-45dc-86a4-34fa37cf47d6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:00.301181 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-f9290015-3fd6-45dc-86a4-34fa37cf47d6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:00.309015 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-f9290015-3fd6-45dc-86a4-34fa37cf47d6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.157080 Jun 16 21:15:00.309588 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 118/250] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:00 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:00.696452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-27a02d6d-09dd-4495-ab24-358f12d1a6d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:15:00.696975 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-27a02d6d-09dd-4495-ab24-358f12d1a6d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:00.703116 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-27a02d6d-09dd-4495-ab24-358f12d1a6d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:00.703554 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-27a02d6d-09dd-4495-ab24-358f12d1a6d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:00.704346 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-27a02d6d-09dd-4495-ab24-358f12d1a6d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:00.704781 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-27a02d6d-09dd-4495-ab24-358f12d1a6d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:00.727971 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.objects.instance [None req-27a02d6d-09dd-4495-ab24-358f12d1a6d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lazy-loading 'flavor' on Instance uuid 2281b8c3-ec1f-478b-bd50-128d5cf67a04 {{(pid=117737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:15:01.035229 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-27a02d6d-09dd-4495-ab24-358f12d1a6d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "POST /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/action" status: 202 len: 0 microversion: 2.20 time: 0.343608 Jun 16 21:15:01.035865 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 133/251] 10.222.0.43 () {62 vars in 1318 bytes} [Thu Jun 16 21:15:00 2022] POST /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:15:01.045549 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0758f1f3-6a86-4774-84c4-3376bb2d3f1d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:01.046374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0758f1f3-6a86-4774-84c4-3376bb2d3f1d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:01.052722 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0758f1f3-6a86-4774-84c4-3376bb2d3f1d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:01.053964 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0758f1f3-6a86-4774-84c4-3376bb2d3f1d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:01.055242 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0758f1f3-6a86-4774-84c4-3376bb2d3f1d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:01.055766 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0758f1f3-6a86-4774-84c4-3376bb2d3f1d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:01.187603 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0758f1f3-6a86-4774-84c4-3376bb2d3f1d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:01.195933 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0758f1f3-6a86-4774-84c4-3376bb2d3f1d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:01.197472 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0758f1f3-6a86-4774-84c4-3376bb2d3f1d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:01.198653 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0758f1f3-6a86-4774-84c4-3376bb2d3f1d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.157793 Jun 16 21:15:01.199204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 119/252] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:01 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:01.326851 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e9b6b21c-5b70-4295-81d1-e8bd53003f44 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:01.327546 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e9b6b21c-5b70-4295-81d1-e8bd53003f44 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:01.333968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e9b6b21c-5b70-4295-81d1-e8bd53003f44 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:01.334916 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e9b6b21c-5b70-4295-81d1-e8bd53003f44 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:01.336184 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e9b6b21c-5b70-4295-81d1-e8bd53003f44 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:01.336631 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e9b6b21c-5b70-4295-81d1-e8bd53003f44 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:01.356067 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:01.473014 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e9b6b21c-5b70-4295-81d1-e8bd53003f44 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:01.480626 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e9b6b21c-5b70-4295-81d1-e8bd53003f44 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.157959 Jun 16 21:15:01.481181 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 134/253] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:01 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:02.217670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c8050175-05aa-47b5-9065-fa8c2ac8205a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:02.218434 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c8050175-05aa-47b5-9065-fa8c2ac8205a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:02.226547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c8050175-05aa-47b5-9065-fa8c2ac8205a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:02.227110 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c8050175-05aa-47b5-9065-fa8c2ac8205a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:02.228075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c8050175-05aa-47b5-9065-fa8c2ac8205a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:02.228625 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c8050175-05aa-47b5-9065-fa8c2ac8205a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:02.453289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c8050175-05aa-47b5-9065-fa8c2ac8205a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:02.461533 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c8050175-05aa-47b5-9065-fa8c2ac8205a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:02.463313 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c8050175-05aa-47b5-9065-fa8c2ac8205a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:02.464836 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c8050175-05aa-47b5-9065-fa8c2ac8205a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.251123 Jun 16 21:15:02.465521 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 120/254] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:02 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:02.497850 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-bb61d98d-5bbf-4a5e-92cd-ddbbc19072c5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:02.498487 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-bb61d98d-5bbf-4a5e-92cd-ddbbc19072c5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:02.506988 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bb61d98d-5bbf-4a5e-92cd-ddbbc19072c5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:02.507797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bb61d98d-5bbf-4a5e-92cd-ddbbc19072c5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:02.508843 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bb61d98d-5bbf-4a5e-92cd-ddbbc19072c5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:02.509283 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bb61d98d-5bbf-4a5e-92cd-ddbbc19072c5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:02.868558 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bb61d98d-5bbf-4a5e-92cd-ddbbc19072c5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:02.878217 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-bb61d98d-5bbf-4a5e-92cd-ddbbc19072c5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.384048 Jun 16 21:15:02.880218 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 135/255] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:02 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:03.485380 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2342b8f8-1ea7-4786-b2ac-41f62e1453bf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:03.486097 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2342b8f8-1ea7-4786-b2ac-41f62e1453bf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:03.497819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2342b8f8-1ea7-4786-b2ac-41f62e1453bf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:03.498501 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2342b8f8-1ea7-4786-b2ac-41f62e1453bf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:03.499454 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2342b8f8-1ea7-4786-b2ac-41f62e1453bf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:03.500020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2342b8f8-1ea7-4786-b2ac-41f62e1453bf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:03.728666 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2342b8f8-1ea7-4786-b2ac-41f62e1453bf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:03.736704 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2342b8f8-1ea7-4786-b2ac-41f62e1453bf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:03.738191 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2342b8f8-1ea7-4786-b2ac-41f62e1453bf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:03.739337 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2342b8f8-1ea7-4786-b2ac-41f62e1453bf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.258555 Jun 16 21:15:03.739888 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 121/256] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:03 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:03.894902 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c0c584cc-964f-47ba-9050-2cc32d2b85fe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:03.895521 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c0c584cc-964f-47ba-9050-2cc32d2b85fe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:03.902352 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c0c584cc-964f-47ba-9050-2cc32d2b85fe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:03.903020 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c0c584cc-964f-47ba-9050-2cc32d2b85fe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:03.903789 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c0c584cc-964f-47ba-9050-2cc32d2b85fe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:03.904410 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c0c584cc-964f-47ba-9050-2cc32d2b85fe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:04.047427 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3615467a-9ab5-457d-9ccc-27926f91c22b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:04.047914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-3615467a-9ab5-457d-9ccc-27926f91c22b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:04.055763 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3615467a-9ab5-457d-9ccc-27926f91c22b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:04.056482 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3615467a-9ab5-457d-9ccc-27926f91c22b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:04.057542 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3615467a-9ab5-457d-9ccc-27926f91c22b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:04.058115 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3615467a-9ab5-457d-9ccc-27926f91c22b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:04.088653 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-3615467a-9ab5-457d-9ccc-27926f91c22b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0/ips" status: 200 len: 150 microversion: 2.1 time: 0.044890 Jun 16 21:15:04.090290 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 122/257] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 16 21:15:04 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:15:04.244545 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c0c584cc-964f-47ba-9050-2cc32d2b85fe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:04.258374 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c0c584cc-964f-47ba-9050-2cc32d2b85fe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.367195 Jun 16 21:15:04.259653 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 136/258] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:03 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:04.759020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3c766348-3e66-4066-af8a-28596068da38 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:04.759632 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-3c766348-3e66-4066-af8a-28596068da38 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:04.771578 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3c766348-3e66-4066-af8a-28596068da38 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:04.771578 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3c766348-3e66-4066-af8a-28596068da38 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:04.774416 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3c766348-3e66-4066-af8a-28596068da38 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:04.780118 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3c766348-3e66-4066-af8a-28596068da38 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:04.827492 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-03a4d687-c4a5-4302-979f-9ef0c0d4e532 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:04.828676 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-03a4d687-c4a5-4302-979f-9ef0c0d4e532 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:04.843863 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-03a4d687-c4a5-4302-979f-9ef0c0d4e532 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:04.844927 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-03a4d687-c4a5-4302-979f-9ef0c0d4e532 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:04.845989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-03a4d687-c4a5-4302-979f-9ef0c0d4e532 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:04.846686 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-03a4d687-c4a5-4302-979f-9ef0c0d4e532 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:04.885671 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-03a4d687-c4a5-4302-979f-9ef0c0d4e532 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/ips" status: 200 len: 145 microversion: 2.1 time: 0.062647 Jun 16 21:15:04.886260 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 137/259] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 16 21:15:04 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/ips => generated 145 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:15:05.109716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-3c766348-3e66-4066-af8a-28596068da38 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:05.137305 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-3c766348-3e66-4066-af8a-28596068da38 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:05.138891 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-3c766348-3e66-4066-af8a-28596068da38 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:05.144301 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-3c766348-3e66-4066-af8a-28596068da38 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.385549 Jun 16 21:15:05.147751 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 123/260] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:04 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:05.277139 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-84a06d83-631a-41aa-be26-52553ff66549 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:05.278084 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-84a06d83-631a-41aa-be26-52553ff66549 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:05.284531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-84a06d83-631a-41aa-be26-52553ff66549 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:05.284965 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-84a06d83-631a-41aa-be26-52553ff66549 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:05.285916 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-84a06d83-631a-41aa-be26-52553ff66549 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:05.286347 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-84a06d83-631a-41aa-be26-52553ff66549 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:05.527271 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-84a06d83-631a-41aa-be26-52553ff66549 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:05.535538 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-84a06d83-631a-41aa-be26-52553ff66549 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.264430 Jun 16 21:15:05.545450 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-94d8ba19-8090-40c1-bf96-9c14f17ab260 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc3bd7af-5846-41c2-a281-2859250c784c"}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:15:05.546590 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-94d8ba19-8090-40c1-bf96-9c14f17ab260 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:05.549940 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 138/261] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:05 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:05.554212 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-94d8ba19-8090-40c1-bf96-9c14f17ab260 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:05.554656 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-94d8ba19-8090-40c1-bf96-9c14f17ab260 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:05.555469 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-94d8ba19-8090-40c1-bf96-9c14f17ab260 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:05.555906 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-94d8ba19-8090-40c1-bf96-9c14f17ab260 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:05.911744 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-94d8ba19-8090-40c1-bf96-9c14f17ab260 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "POST /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.373839 Jun 16 21:15:05.918844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 124/262] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 16 21:15:05 2022] POST /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:15:06.165419 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-bcc956fd-b12d-4af1-9373-3dc126df96d1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:06.166289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-bcc956fd-b12d-4af1-9373-3dc126df96d1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:06.173720 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bcc956fd-b12d-4af1-9373-3dc126df96d1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:06.174419 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bcc956fd-b12d-4af1-9373-3dc126df96d1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:06.175718 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bcc956fd-b12d-4af1-9373-3dc126df96d1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:06.176644 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bcc956fd-b12d-4af1-9373-3dc126df96d1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:06.428541 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bcc956fd-b12d-4af1-9373-3dc126df96d1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:06.438415 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bcc956fd-b12d-4af1-9373-3dc126df96d1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:06.440903 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bcc956fd-b12d-4af1-9373-3dc126df96d1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:06.442453 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-bcc956fd-b12d-4af1-9373-3dc126df96d1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.280928 Jun 16 21:15:06.455094 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 139/263] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:06 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:15:06.554103 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3c078c18-681c-4c30-9f7a-8f96012fdb9b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:06.554851 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-3c078c18-681c-4c30-9f7a-8f96012fdb9b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:06.561204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3c078c18-681c-4c30-9f7a-8f96012fdb9b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:06.561643 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3c078c18-681c-4c30-9f7a-8f96012fdb9b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:06.563066 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3c078c18-681c-4c30-9f7a-8f96012fdb9b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:06.563543 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3c078c18-681c-4c30-9f7a-8f96012fdb9b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:06.728210 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-3c078c18-681c-4c30-9f7a-8f96012fdb9b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:06.742751 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-3c078c18-681c-4c30-9f7a-8f96012fdb9b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.193694 Jun 16 21:15:06.766897 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 125/264] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:06 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:07.463311 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b930487e-822c-4210-825c-09c02e0f9289 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:07.464293 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b930487e-822c-4210-825c-09c02e0f9289 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:07.467909 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=66 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:07.474275 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b930487e-822c-4210-825c-09c02e0f9289 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:07.474813 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b930487e-822c-4210-825c-09c02e0f9289 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:07.476575 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b930487e-822c-4210-825c-09c02e0f9289 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:07.477203 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b930487e-822c-4210-825c-09c02e0f9289 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:07.688300 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b930487e-822c-4210-825c-09c02e0f9289 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:07.697946 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b930487e-822c-4210-825c-09c02e0f9289 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:07.699541 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b930487e-822c-4210-825c-09c02e0f9289 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:07.700765 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b930487e-822c-4210-825c-09c02e0f9289 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.242409 Jun 16 21:15:07.711774 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 140/265] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:07 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:07.762199 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-75ea30b7-8897-4273-8b46-30184646c6be tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:07.763499 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-75ea30b7-8897-4273-8b46-30184646c6be tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:07.780727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:07.782481 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-75ea30b7-8897-4273-8b46-30184646c6be tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:07.783018 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-75ea30b7-8897-4273-8b46-30184646c6be tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:07.786339 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-75ea30b7-8897-4273-8b46-30184646c6be tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:07.787008 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-75ea30b7-8897-4273-8b46-30184646c6be tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:07.903934 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f5341d9b-2284-46e2-8441-45e7e0248616 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91fbce58-960d-40a7-903b-407b5d8566d6", "device": "/dev/sdb"}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:15:07.906603 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f5341d9b-2284-46e2-8441-45e7e0248616 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:07.913768 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f5341d9b-2284-46e2-8441-45e7e0248616 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:07.914217 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f5341d9b-2284-46e2-8441-45e7e0248616 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:07.915364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f5341d9b-2284-46e2-8441-45e7e0248616 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:07.915800 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f5341d9b-2284-46e2-8441-45e7e0248616 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:08.021669 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-75ea30b7-8897-4273-8b46-30184646c6be tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:08.031013 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-75ea30b7-8897-4273-8b46-30184646c6be tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.273416 Jun 16 21:15:08.035187 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 126/266] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:07 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:08.261658 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f5341d9b-2284-46e2-8441-45e7e0248616 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "POST /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361523 Jun 16 21:15:08.262398 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 141/267] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 16 21:15:07 2022] POST /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:15:08.383161 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2522c338-9ea3-46e6-b23e-0b03c4a97767 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2ac8076-d889-458b-b8c9-cc6c624e1fd5"}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:15:08.384923 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2522c338-9ea3-46e6-b23e-0b03c4a97767 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:08.400327 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2522c338-9ea3-46e6-b23e-0b03c4a97767 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:08.400836 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2522c338-9ea3-46e6-b23e-0b03c4a97767 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:08.401676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2522c338-9ea3-46e6-b23e-0b03c4a97767 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:08.402116 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2522c338-9ea3-46e6-b23e-0b03c4a97767 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:08.543424 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:08.700664 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2522c338-9ea3-46e6-b23e-0b03c4a97767 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "POST /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322422 Jun 16 21:15:08.701432 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 127/268] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 16 21:15:08 2022] POST /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:15:08.719558 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c03237ce-034e-445f-ac3d-971f932da8aa tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:08.720497 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c03237ce-034e-445f-ac3d-971f932da8aa tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:08.729996 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c03237ce-034e-445f-ac3d-971f932da8aa tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:08.730833 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c03237ce-034e-445f-ac3d-971f932da8aa tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:08.731789 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c03237ce-034e-445f-ac3d-971f932da8aa tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:08.732464 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c03237ce-034e-445f-ac3d-971f932da8aa tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:08.956044 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c03237ce-034e-445f-ac3d-971f932da8aa tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:08.965098 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c03237ce-034e-445f-ac3d-971f932da8aa tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:08.966635 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c03237ce-034e-445f-ac3d-971f932da8aa tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:08.967967 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c03237ce-034e-445f-ac3d-971f932da8aa tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.252729 Jun 16 21:15:08.968548 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 142/269] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:08 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:09.051300 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-898ce524-424d-46bc-9861-e273b56f8f8b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:09.051680 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-898ce524-424d-46bc-9861-e273b56f8f8b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:09.064254 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-898ce524-424d-46bc-9861-e273b56f8f8b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:09.064695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-898ce524-424d-46bc-9861-e273b56f8f8b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:09.065572 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-898ce524-424d-46bc-9861-e273b56f8f8b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:09.065959 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-898ce524-424d-46bc-9861-e273b56f8f8b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:09.234769 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-898ce524-424d-46bc-9861-e273b56f8f8b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:09.257791 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-898ce524-424d-46bc-9861-e273b56f8f8b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.212786 Jun 16 21:15:09.258503 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 128/270] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:09 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:09.987951 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-87c7da0a-c31f-4d23-8921-cd8928e45cde tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:09.989364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-87c7da0a-c31f-4d23-8921-cd8928e45cde tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:09.998087 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-87c7da0a-c31f-4d23-8921-cd8928e45cde tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:09.998618 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-87c7da0a-c31f-4d23-8921-cd8928e45cde tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:09.999782 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-87c7da0a-c31f-4d23-8921-cd8928e45cde tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:10.000448 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-87c7da0a-c31f-4d23-8921-cd8928e45cde tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:10.243809 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-87c7da0a-c31f-4d23-8921-cd8928e45cde tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:10.256890 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-87c7da0a-c31f-4d23-8921-cd8928e45cde tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:10.264843 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-87c7da0a-c31f-4d23-8921-cd8928e45cde tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:10.273289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-87c7da0a-c31f-4d23-8921-cd8928e45cde tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.290091 Jun 16 21:15:10.273851 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 143/271] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:09 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:10.276957 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c43e5952-40fc-4a67-8cef-a4cde16474f3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:10.278273 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c43e5952-40fc-4a67-8cef-a4cde16474f3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:10.289732 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c43e5952-40fc-4a67-8cef-a4cde16474f3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:10.294316 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c43e5952-40fc-4a67-8cef-a4cde16474f3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:10.295129 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c43e5952-40fc-4a67-8cef-a4cde16474f3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:10.296743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c43e5952-40fc-4a67-8cef-a4cde16474f3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:10.687065 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c43e5952-40fc-4a67-8cef-a4cde16474f3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:10.700331 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c43e5952-40fc-4a67-8cef-a4cde16474f3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.429101 Jun 16 21:15:10.701224 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 129/272] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:10 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:11.291976 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c21a8bd4-1381-433a-8bfe-0bc9b41ce03f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:11.292760 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c21a8bd4-1381-433a-8bfe-0bc9b41ce03f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:11.306787 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c21a8bd4-1381-433a-8bfe-0bc9b41ce03f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:11.307539 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c21a8bd4-1381-433a-8bfe-0bc9b41ce03f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:11.308511 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c21a8bd4-1381-433a-8bfe-0bc9b41ce03f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:11.310372 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c21a8bd4-1381-433a-8bfe-0bc9b41ce03f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:11.718805 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1cc14486-169d-4374-bc00-4d03908427d9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:11.720069 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1cc14486-169d-4374-bc00-4d03908427d9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:11.729978 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1cc14486-169d-4374-bc00-4d03908427d9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:11.734326 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1cc14486-169d-4374-bc00-4d03908427d9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:11.735388 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1cc14486-169d-4374-bc00-4d03908427d9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:11.737423 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1cc14486-169d-4374-bc00-4d03908427d9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:11.799043 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c21a8bd4-1381-433a-8bfe-0bc9b41ce03f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:11.812928 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c21a8bd4-1381-433a-8bfe-0bc9b41ce03f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:11.815982 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c21a8bd4-1381-433a-8bfe-0bc9b41ce03f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:11.817758 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c21a8bd4-1381-433a-8bfe-0bc9b41ce03f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.530442 Jun 16 21:15:11.828942 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 144/273] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:11 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:11.946412 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1cc14486-169d-4374-bc00-4d03908427d9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:11.957765 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1cc14486-169d-4374-bc00-4d03908427d9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.242282 Jun 16 21:15:11.958844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 130/274] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:11 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:12.838130 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4f4d1a55-caa6-4d28-b47e-cd7071a132bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:12.838843 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4f4d1a55-caa6-4d28-b47e-cd7071a132bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:12.847113 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f4d1a55-caa6-4d28-b47e-cd7071a132bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:12.847681 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f4d1a55-caa6-4d28-b47e-cd7071a132bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:12.848564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f4d1a55-caa6-4d28-b47e-cd7071a132bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:12.849364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f4d1a55-caa6-4d28-b47e-cd7071a132bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:12.977244 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a65d2c71-a006-4d96-b196-cf353ee41025 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:12.979241 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a65d2c71-a006-4d96-b196-cf353ee41025 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:12.996363 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a65d2c71-a006-4d96-b196-cf353ee41025 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:12.997154 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a65d2c71-a006-4d96-b196-cf353ee41025 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:12.998278 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a65d2c71-a006-4d96-b196-cf353ee41025 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:12.998897 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a65d2c71-a006-4d96-b196-cf353ee41025 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:13.009046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4f4d1a55-caa6-4d28-b47e-cd7071a132bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:13.018519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4f4d1a55-caa6-4d28-b47e-cd7071a132bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:13.021063 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4f4d1a55-caa6-4d28-b47e-cd7071a132bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:13.023387 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4f4d1a55-caa6-4d28-b47e-cd7071a132bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.189751 Jun 16 21:15:13.024619 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 145/275] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:12 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:13.248606 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a65d2c71-a006-4d96-b196-cf353ee41025 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:13.264481 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a65d2c71-a006-4d96-b196-cf353ee41025 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.290437 Jun 16 21:15:13.265453 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 131/276] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:12 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:14.043121 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ae12b46a-b1e8-4a8b-a712-c3a7702a3e88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:14.043886 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ae12b46a-b1e8-4a8b-a712-c3a7702a3e88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:14.050788 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ae12b46a-b1e8-4a8b-a712-c3a7702a3e88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:14.051359 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ae12b46a-b1e8-4a8b-a712-c3a7702a3e88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:14.052515 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ae12b46a-b1e8-4a8b-a712-c3a7702a3e88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:14.053151 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ae12b46a-b1e8-4a8b-a712-c3a7702a3e88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:14.214778 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-ae12b46a-b1e8-4a8b-a712-c3a7702a3e88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:14.223521 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-ae12b46a-b1e8-4a8b-a712-c3a7702a3e88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:14.225649 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-ae12b46a-b1e8-4a8b-a712-c3a7702a3e88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:14.226943 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ae12b46a-b1e8-4a8b-a712-c3a7702a3e88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.188222 Jun 16 21:15:14.238095 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 146/277] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:14 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:14.282086 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-86b476d7-a91f-4863-93d2-2ec76941fba5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:14.282701 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-86b476d7-a91f-4863-93d2-2ec76941fba5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:14.289273 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-86b476d7-a91f-4863-93d2-2ec76941fba5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:14.289718 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-86b476d7-a91f-4863-93d2-2ec76941fba5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:14.290483 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-86b476d7-a91f-4863-93d2-2ec76941fba5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:14.290912 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-86b476d7-a91f-4863-93d2-2ec76941fba5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:14.468202 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-86b476d7-a91f-4863-93d2-2ec76941fba5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:14.478614 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-86b476d7-a91f-4863-93d2-2ec76941fba5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.200033 Jun 16 21:15:14.480027 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 132/278] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:14 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:15.245726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5cc3f843-990e-4d0e-bc91-3b0ef0e388a7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:15.246321 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5cc3f843-990e-4d0e-bc91-3b0ef0e388a7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:15.259373 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5cc3f843-990e-4d0e-bc91-3b0ef0e388a7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:15.260086 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5cc3f843-990e-4d0e-bc91-3b0ef0e388a7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:15.261280 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5cc3f843-990e-4d0e-bc91-3b0ef0e388a7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:15.261955 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5cc3f843-990e-4d0e-bc91-3b0ef0e388a7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:15.498957 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-974cf508-f286-49eb-a960-60c9d42d825e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:15.500195 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-974cf508-f286-49eb-a960-60c9d42d825e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:15.513969 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-974cf508-f286-49eb-a960-60c9d42d825e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:15.514711 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-974cf508-f286-49eb-a960-60c9d42d825e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:15.515538 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-974cf508-f286-49eb-a960-60c9d42d825e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:15.520385 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5cc3f843-990e-4d0e-bc91-3b0ef0e388a7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:15.521920 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-974cf508-f286-49eb-a960-60c9d42d825e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:15.531230 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5cc3f843-990e-4d0e-bc91-3b0ef0e388a7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:15.533034 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5cc3f843-990e-4d0e-bc91-3b0ef0e388a7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:15.534486 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5cc3f843-990e-4d0e-bc91-3b0ef0e388a7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.292617 Jun 16 21:15:15.535550 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 147/279] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:15 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:15.715382 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-974cf508-f286-49eb-a960-60c9d42d825e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:15.727555 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-974cf508-f286-49eb-a960-60c9d42d825e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.233949 Jun 16 21:15:15.729039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 133/280] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:15 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:16.554166 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1886fd73-8a76-4ed6-adce-70288da2976e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:16.554782 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1886fd73-8a76-4ed6-adce-70288da2976e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:16.565618 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1886fd73-8a76-4ed6-adce-70288da2976e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:16.566072 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1886fd73-8a76-4ed6-adce-70288da2976e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:16.566862 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1886fd73-8a76-4ed6-adce-70288da2976e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:16.567359 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1886fd73-8a76-4ed6-adce-70288da2976e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:16.735694 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1886fd73-8a76-4ed6-adce-70288da2976e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:16.746441 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-f6bba312-d0c2-4a32-b05c-0f1215488a6f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:16.748005 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-f6bba312-d0c2-4a32-b05c-0f1215488a6f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:16.755025 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f6bba312-d0c2-4a32-b05c-0f1215488a6f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:16.755323 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1886fd73-8a76-4ed6-adce-70288da2976e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:16.755710 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f6bba312-d0c2-4a32-b05c-0f1215488a6f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:16.756779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f6bba312-d0c2-4a32-b05c-0f1215488a6f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:16.757257 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1886fd73-8a76-4ed6-adce-70288da2976e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:16.757895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f6bba312-d0c2-4a32-b05c-0f1215488a6f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:16.758478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1886fd73-8a76-4ed6-adce-70288da2976e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.208447 Jun 16 21:15:16.764672 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 148/281] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:16 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:16.949901 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-f6bba312-d0c2-4a32-b05c-0f1215488a6f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:16.958433 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-f6bba312-d0c2-4a32-b05c-0f1215488a6f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.216017 Jun 16 21:15:16.959546 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 134/282] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:16 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:17.062166 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-3670e046-5552-4984-906c-dbfb822e5439 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Action: 'create', calling method: .version_select at 0x7fb3fc075d30>, body: {"keypair": {"name": "tempest-keypair-1912746294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsvSi8IXpV+yjNnhP3q/mJeJV3sG2CaUd2XS61rZib4S5S+BjVWWyztZ0Np2i2WUJ7ZIdl2ZdjMFVxQhagOyCbXJpj9mOSgo7awKvok5ww3oBhBewknmVOKWqdYOtsGzg=="}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:15:17.094450 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-3670e046-5552-4984-906c-dbfb822e5439 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Getting quotas for project f22cbeb1402848dbb84a5718dca357e1. Resources: {'key_pairs'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:15:17.098407 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-3670e046-5552-4984-906c-dbfb822e5439 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Getting quotas for user 2cb12a51b62c48ba95be62f167b7314e and project f22cbeb1402848dbb84a5718dca357e1. Resources: {'key_pairs'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:15:17.145195 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-3670e046-5552-4984-906c-dbfb822e5439 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087488 Jun 16 21:15:17.145914 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 149/283] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 16 21:15:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:15:17.783833 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-370635ff-0100-4f03-b2f0-a38c2e2d4a65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:17.784511 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-370635ff-0100-4f03-b2f0-a38c2e2d4a65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:17.795074 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-370635ff-0100-4f03-b2f0-a38c2e2d4a65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:17.795786 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-370635ff-0100-4f03-b2f0-a38c2e2d4a65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:17.799206 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-370635ff-0100-4f03-b2f0-a38c2e2d4a65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:17.802098 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-370635ff-0100-4f03-b2f0-a38c2e2d4a65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:17.976707 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-236492ba-9393-448e-bbe6-5a844aefd584 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:17.978001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-236492ba-9393-448e-bbe6-5a844aefd584 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:18.019929 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-236492ba-9393-448e-bbe6-5a844aefd584 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:18.025966 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-236492ba-9393-448e-bbe6-5a844aefd584 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:18.029986 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-236492ba-9393-448e-bbe6-5a844aefd584 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:18.033148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-236492ba-9393-448e-bbe6-5a844aefd584 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:18.352696 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-236492ba-9393-448e-bbe6-5a844aefd584 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:18.375117 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-236492ba-9393-448e-bbe6-5a844aefd584 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.395787 Jun 16 21:15:18.376686 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 150/284] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:17 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:18.507697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-370635ff-0100-4f03-b2f0-a38c2e2d4a65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:18.542477 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-370635ff-0100-4f03-b2f0-a38c2e2d4a65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:18.547193 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-370635ff-0100-4f03-b2f0-a38c2e2d4a65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:18.555856 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-370635ff-0100-4f03-b2f0-a38c2e2d4a65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.776010 Jun 16 21:15:18.557415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 135/285] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:17 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:19.393551 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-64822c35-071d-4f03-9d66-8bbb841fc199 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:19.394856 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-64822c35-071d-4f03-9d66-8bbb841fc199 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:19.419395 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-64822c35-071d-4f03-9d66-8bbb841fc199 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:19.422367 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-64822c35-071d-4f03-9d66-8bbb841fc199 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:19.424152 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-64822c35-071d-4f03-9d66-8bbb841fc199 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:19.428455 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-64822c35-071d-4f03-9d66-8bbb841fc199 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:19.443505 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:19.575336 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9bdda218-fe79-44b8-b28a-dcb9c3802a8d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:19.575948 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-9bdda218-fe79-44b8-b28a-dcb9c3802a8d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:19.608747 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9bdda218-fe79-44b8-b28a-dcb9c3802a8d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:19.609314 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9bdda218-fe79-44b8-b28a-dcb9c3802a8d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:19.610899 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9bdda218-fe79-44b8-b28a-dcb9c3802a8d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:19.612530 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9bdda218-fe79-44b8-b28a-dcb9c3802a8d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:19.650353 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-64822c35-071d-4f03-9d66-8bbb841fc199 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:19.675558 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-64822c35-071d-4f03-9d66-8bbb841fc199 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.284711 Jun 16 21:15:19.675558 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 151/286] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:19 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:19.813152 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-785d8a09-cc24-4f87-895e-73617a52d565 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-911540465", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4d0a869-8cad-4582-83ab-86c097e04c69"}], "security_groups": [{"name": "tempest-securitygroup--336715271"}], "key_name": "tempest-keypair-1912746294", "user_data": "}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:15:19.872433 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9bdda218-fe79-44b8-b28a-dcb9c3802a8d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:19.884505 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9bdda218-fe79-44b8-b28a-dcb9c3802a8d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:19.887378 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9bdda218-fe79-44b8-b28a-dcb9c3802a8d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:19.903906 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-9bdda218-fe79-44b8-b28a-dcb9c3802a8d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.317812 Jun 16 21:15:19.905085 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 136/287] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:19 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:15:19.949631 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.network.neutron [None req-785d8a09-cc24-4f87-895e-73617a52d565 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] validate_networks() for [('c4d0a869-8cad-4582-83ab-86c097e04c69', None, None, None, None, None)] {{(pid=117737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:15:20.452309 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-785d8a09-cc24-4f87-895e-73617a52d565 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Flavor limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:15:20.452950 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-785d8a09-cc24-4f87-895e-73617a52d565 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Image limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:15:20.453176 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-785d8a09-cc24-4f87-895e-73617a52d565 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Flavor pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:15:20.453755 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-785d8a09-cc24-4f87-895e-73617a52d565 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Image pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:15:20.454161 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-785d8a09-cc24-4f87-895e-73617a52d565 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:15:20.463867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-785d8a09-cc24-4f87-895e-73617a52d565 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:20.464360 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-785d8a09-cc24-4f87-895e-73617a52d565 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:20.465205 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-785d8a09-cc24-4f87-895e-73617a52d565 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:20.465808 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-785d8a09-cc24-4f87-895e-73617a52d565 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:20.483346 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-785d8a09-cc24-4f87-895e-73617a52d565 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Getting quotas for project f22cbeb1402848dbb84a5718dca357e1. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:15:20.487778 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-785d8a09-cc24-4f87-895e-73617a52d565 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Getting quotas for user 2cb12a51b62c48ba95be62f167b7314e and project f22cbeb1402848dbb84a5718dca357e1. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:15:20.501217 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-785d8a09-cc24-4f87-895e-73617a52d565 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Going to run 1 instances... {{(pid=117737) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:15:20.503461 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-785d8a09-cc24-4f87-895e-73617a52d565 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:15:20.552666 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-785d8a09-cc24-4f87-895e-73617a52d565 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.743584 Jun 16 21:15:20.553625 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 152/288] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:15:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:15:20.563679 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-41d5c34f-97a4-4c3e-bcd7-5cbbeaae7e1e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:20.571527 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-41d5c34f-97a4-4c3e-bcd7-5cbbeaae7e1e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:20.693492 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-2530ed90-ec78-4bad-8e5d-2cb78fddf990 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:20.694669 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-2530ed90-ec78-4bad-8e5d-2cb78fddf990 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:20.705245 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2530ed90-ec78-4bad-8e5d-2cb78fddf990 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:20.705918 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2530ed90-ec78-4bad-8e5d-2cb78fddf990 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:20.707480 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2530ed90-ec78-4bad-8e5d-2cb78fddf990 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:20.708218 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2530ed90-ec78-4bad-8e5d-2cb78fddf990 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:20.915111 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2530ed90-ec78-4bad-8e5d-2cb78fddf990 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:20.923579 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-2530ed90-ec78-4bad-8e5d-2cb78fddf990 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.233984 Jun 16 21:15:20.924158 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 153/289] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:20 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:20.930732 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0f4e597e-b750-47f2-b01e-f8674164d26c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:20.932089 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0f4e597e-b750-47f2-b01e-f8674164d26c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:20.940950 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0f4e597e-b750-47f2-b01e-f8674164d26c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:20.941664 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0f4e597e-b750-47f2-b01e-f8674164d26c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:20.942632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0f4e597e-b750-47f2-b01e-f8674164d26c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:20.943210 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0f4e597e-b750-47f2-b01e-f8674164d26c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:21.034902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-41d5c34f-97a4-4c3e-bcd7-5cbbeaae7e1e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:21.051267 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-41d5c34f-97a4-4c3e-bcd7-5cbbeaae7e1e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1241 microversion: 2.1 time: 0.491305 Jun 16 21:15:21.054915 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 137/290] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:20 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1241 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:21.102810 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0f4e597e-b750-47f2-b01e-f8674164d26c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:21.112463 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0f4e597e-b750-47f2-b01e-f8674164d26c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:21.114344 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0f4e597e-b750-47f2-b01e-f8674164d26c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:21.115653 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0f4e597e-b750-47f2-b01e-f8674164d26c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.189318 Jun 16 21:15:21.116678 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 154/291] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:20 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:21.941273 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9ce03c74-e347-4a98-9e92-9664073de060 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:21.942345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-9ce03c74-e347-4a98-9e92-9664073de060 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:21.950173 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9ce03c74-e347-4a98-9e92-9664073de060 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:21.950834 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9ce03c74-e347-4a98-9e92-9664073de060 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:21.951793 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9ce03c74-e347-4a98-9e92-9664073de060 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:21.952783 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9ce03c74-e347-4a98-9e92-9664073de060 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:22.067748 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-548d9db6-69fb-468a-96f2-25cfeb42dd3e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:22.070054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-548d9db6-69fb-468a-96f2-25cfeb42dd3e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:22.099992 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-548d9db6-69fb-468a-96f2-25cfeb42dd3e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:22.101181 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-548d9db6-69fb-468a-96f2-25cfeb42dd3e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:22.102256 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-548d9db6-69fb-468a-96f2-25cfeb42dd3e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:22.102829 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-548d9db6-69fb-468a-96f2-25cfeb42dd3e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:22.119262 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9ce03c74-e347-4a98-9e92-9664073de060 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:22.127598 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-9ce03c74-e347-4a98-9e92-9664073de060 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.190125 Jun 16 21:15:22.140298 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 138/292] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:21 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:22.145854 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-cd456fc1-e7c3-4495-84ad-c984ed602bfe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:22.147291 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-cd456fc1-e7c3-4495-84ad-c984ed602bfe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:22.154196 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cd456fc1-e7c3-4495-84ad-c984ed602bfe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:22.154901 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cd456fc1-e7c3-4495-84ad-c984ed602bfe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:22.155818 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cd456fc1-e7c3-4495-84ad-c984ed602bfe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:22.156427 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cd456fc1-e7c3-4495-84ad-c984ed602bfe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:22.197537 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-548d9db6-69fb-468a-96f2-25cfeb42dd3e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:22.213503 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-548d9db6-69fb-468a-96f2-25cfeb42dd3e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1245 microversion: 2.1 time: 0.142059 Jun 16 21:15:22.213503 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 155/293] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:22 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1245 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:22.314908 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-cd456fc1-e7c3-4495-84ad-c984ed602bfe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:22.323361 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-cd456fc1-e7c3-4495-84ad-c984ed602bfe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:22.324913 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-cd456fc1-e7c3-4495-84ad-c984ed602bfe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:22.326118 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-cd456fc1-e7c3-4495-84ad-c984ed602bfe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.184485 Jun 16 21:15:22.326692 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 139/294] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:22 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:23.144884 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ed6fb1c3-11c9-46cb-9f78-b1b3dc5efe7d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:23.146328 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ed6fb1c3-11c9-46cb-9f78-b1b3dc5efe7d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:23.153219 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ed6fb1c3-11c9-46cb-9f78-b1b3dc5efe7d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:23.153967 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ed6fb1c3-11c9-46cb-9f78-b1b3dc5efe7d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:23.155706 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ed6fb1c3-11c9-46cb-9f78-b1b3dc5efe7d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:23.156241 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ed6fb1c3-11c9-46cb-9f78-b1b3dc5efe7d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:23.225919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4101ebb3-a014-467a-b67d-e88c1291ad68 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:23.227406 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4101ebb3-a014-467a-b67d-e88c1291ad68 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:23.236375 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4101ebb3-a014-467a-b67d-e88c1291ad68 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:23.237456 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4101ebb3-a014-467a-b67d-e88c1291ad68 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:23.238338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4101ebb3-a014-467a-b67d-e88c1291ad68 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:23.238883 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4101ebb3-a014-467a-b67d-e88c1291ad68 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:23.314238 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4101ebb3-a014-467a-b67d-e88c1291ad68 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:23.317392 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-ed6fb1c3-11c9-46cb-9f78-b1b3dc5efe7d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:23.328146 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ed6fb1c3-11c9-46cb-9f78-b1b3dc5efe7d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.187300 Jun 16 21:15:23.328758 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 156/295] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:23 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:23.338211 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4101ebb3-a014-467a-b67d-e88c1291ad68 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1245 microversion: 2.1 time: 0.107709 Jun 16 21:15:23.338211 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 140/296] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:23 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1245 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:23.347060 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b9ad9dd1-c721-4ae8-954a-b88d51f11242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:23.347993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b9ad9dd1-c721-4ae8-954a-b88d51f11242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:23.357041 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b9ad9dd1-c721-4ae8-954a-b88d51f11242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:23.357647 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b9ad9dd1-c721-4ae8-954a-b88d51f11242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:23.358540 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b9ad9dd1-c721-4ae8-954a-b88d51f11242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:23.359078 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b9ad9dd1-c721-4ae8-954a-b88d51f11242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:23.525107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b9ad9dd1-c721-4ae8-954a-b88d51f11242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:23.539445 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b9ad9dd1-c721-4ae8-954a-b88d51f11242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:23.541795 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b9ad9dd1-c721-4ae8-954a-b88d51f11242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:23.543431 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b9ad9dd1-c721-4ae8-954a-b88d51f11242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.202092 Jun 16 21:15:23.544601 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 157/297] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:23 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:24.357806 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8c63b165-2ea5-43b3-94a9-ef4c226ccee9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:24.358516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-154363c9-8659-4d85-974f-6f7fa22d8171 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:24.359228 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-154363c9-8659-4d85-974f-6f7fa22d8171 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:24.360700 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8c63b165-2ea5-43b3-94a9-ef4c226ccee9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:24.370539 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8c63b165-2ea5-43b3-94a9-ef4c226ccee9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:24.371947 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8c63b165-2ea5-43b3-94a9-ef4c226ccee9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:24.373555 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8c63b165-2ea5-43b3-94a9-ef4c226ccee9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:24.374160 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8c63b165-2ea5-43b3-94a9-ef4c226ccee9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:24.375834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-154363c9-8659-4d85-974f-6f7fa22d8171 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:24.385905 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-154363c9-8659-4d85-974f-6f7fa22d8171 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:24.386921 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-154363c9-8659-4d85-974f-6f7fa22d8171 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:24.387492 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-154363c9-8659-4d85-974f-6f7fa22d8171 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:24.491425 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-154363c9-8659-4d85-974f-6f7fa22d8171 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:24.500158 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-154363c9-8659-4d85-974f-6f7fa22d8171 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1293 microversion: 2.1 time: 0.154807 Jun 16 21:15:24.501073 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 158/298] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:24 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1293 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:24.550451 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8c63b165-2ea5-43b3-94a9-ef4c226ccee9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:24.559761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8c63b165-2ea5-43b3-94a9-ef4c226ccee9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.217870 Jun 16 21:15:24.568223 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 141/299] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:24 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:24.571629 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f1bb83ce-aa41-46ff-90c4-a3c8b04b9b84 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:24.572384 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f1bb83ce-aa41-46ff-90c4-a3c8b04b9b84 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:24.579753 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f1bb83ce-aa41-46ff-90c4-a3c8b04b9b84 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:24.580344 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f1bb83ce-aa41-46ff-90c4-a3c8b04b9b84 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:24.581196 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f1bb83ce-aa41-46ff-90c4-a3c8b04b9b84 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:24.585308 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f1bb83ce-aa41-46ff-90c4-a3c8b04b9b84 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:24.757890 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f1bb83ce-aa41-46ff-90c4-a3c8b04b9b84 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:24.773020 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f1bb83ce-aa41-46ff-90c4-a3c8b04b9b84 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:24.774538 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f1bb83ce-aa41-46ff-90c4-a3c8b04b9b84 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:24.775711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f1bb83ce-aa41-46ff-90c4-a3c8b04b9b84 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1742 microversion: 2.20 time: 0.217434 Jun 16 21:15:24.788226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 159/300] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:24 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1742 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:25.520051 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8478ea3e-7049-4e99-9566-1d1a880848d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:25.521356 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8478ea3e-7049-4e99-9566-1d1a880848d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:25.548735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8478ea3e-7049-4e99-9566-1d1a880848d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:25.549066 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8478ea3e-7049-4e99-9566-1d1a880848d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:25.549887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8478ea3e-7049-4e99-9566-1d1a880848d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:25.550325 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8478ea3e-7049-4e99-9566-1d1a880848d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:25.577004 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-eef7f726-db2a-4c80-977c-c283f0ae6f75 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:25.578235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-eef7f726-db2a-4c80-977c-c283f0ae6f75 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:25.589165 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-eef7f726-db2a-4c80-977c-c283f0ae6f75 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:25.590136 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-eef7f726-db2a-4c80-977c-c283f0ae6f75 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:25.591296 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-eef7f726-db2a-4c80-977c-c283f0ae6f75 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:25.592064 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-eef7f726-db2a-4c80-977c-c283f0ae6f75 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:25.689226 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8478ea3e-7049-4e99-9566-1d1a880848d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:25.703252 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8478ea3e-7049-4e99-9566-1d1a880848d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1299 microversion: 2.1 time: 0.188802 Jun 16 21:15:25.704595 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 142/301] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:25 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1299 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:25.764228 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-eef7f726-db2a-4c80-977c-c283f0ae6f75 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:25.772894 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-eef7f726-db2a-4c80-977c-c283f0ae6f75 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.199732 Jun 16 21:15:25.774050 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 160/302] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:25 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:25.798229 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d9f8c421-ac09-46a1-ab73-4ecff1c4df21 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:25.799192 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d9f8c421-ac09-46a1-ab73-4ecff1c4df21 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:25.808152 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9f8c421-ac09-46a1-ab73-4ecff1c4df21 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:25.808823 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9f8c421-ac09-46a1-ab73-4ecff1c4df21 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:25.809803 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9f8c421-ac09-46a1-ab73-4ecff1c4df21 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:25.810424 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9f8c421-ac09-46a1-ab73-4ecff1c4df21 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:26.075280 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d9f8c421-ac09-46a1-ab73-4ecff1c4df21 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:26.092477 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d9f8c421-ac09-46a1-ab73-4ecff1c4df21 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:26.103069 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d9f8c421-ac09-46a1-ab73-4ecff1c4df21 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:26.104461 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d9f8c421-ac09-46a1-ab73-4ecff1c4df21 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1742 microversion: 2.20 time: 0.309998 Jun 16 21:15:26.110799 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 143/303] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:25 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1742 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:26.156924 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-754a40ad-2881-4bf1-98cd-65cb37585c5b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Action: 'create', calling method: .version_select at 0x7fb3fc33d0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1115147593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUyRBfNpYxpqSOUnKKLxSqSl6X8hgsQA7nY5JcsU9KDxsDGNQJz0JwyZ+YRCkwqG03WJYxSIyMFutOfCT6AKwCM+rrcrIwF7zbYbzDgurHcfXAY3X5y6QgSriwah13J/w=="}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:15:26.172146 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-754a40ad-2881-4bf1-98cd-65cb37585c5b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Getting quotas for project df862b955995466a84bc189d9098d7ce. Resources: {'key_pairs'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:15:26.175994 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-754a40ad-2881-4bf1-98cd-65cb37585c5b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Getting quotas for user 573eab511f4f41b78614247c0f4b99a1 and project df862b955995466a84bc189d9098d7ce. Resources: {'key_pairs'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:15:26.198937 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-754a40ad-2881-4bf1-98cd-65cb37585c5b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045719 Jun 16 21:15:26.199467 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 161/304] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 16 21:15:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:15:26.252289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-80fc78ec-04bf-4214-ae38-03d14138f523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1297629811", "imageRef": "19453f68-f52b-45b6-87fc-2c8e0004a353", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1115147593", "networks": [{"uuid": "df9634fa-1f54-49ef-aa1f-9a93395ae6e0"}]}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:15:26.308803 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.network.neutron [None req-80fc78ec-04bf-4214-ae38-03d14138f523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] validate_networks() for [('df9634fa-1f54-49ef-aa1f-9a93395ae6e0', None, None, None, None, None)] {{(pid=117738) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:15:26.721964 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5792dba8-e490-4620-879c-48b03bf2a2d9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:26.722511 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5792dba8-e490-4620-879c-48b03bf2a2d9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:26.728645 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5792dba8-e490-4620-879c-48b03bf2a2d9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:26.729097 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5792dba8-e490-4620-879c-48b03bf2a2d9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:26.730166 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5792dba8-e490-4620-879c-48b03bf2a2d9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:26.730285 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5792dba8-e490-4620-879c-48b03bf2a2d9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:26.751106 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-80fc78ec-04bf-4214-ae38-03d14138f523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Flavor limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:15:26.751605 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-80fc78ec-04bf-4214-ae38-03d14138f523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Image limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:15:26.752040 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-80fc78ec-04bf-4214-ae38-03d14138f523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Flavor pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:15:26.752478 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-80fc78ec-04bf-4214-ae38-03d14138f523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Image pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:15:26.752888 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-80fc78ec-04bf-4214-ae38-03d14138f523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:15:26.762547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-80fc78ec-04bf-4214-ae38-03d14138f523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:26.762991 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-80fc78ec-04bf-4214-ae38-03d14138f523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:26.763790 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-80fc78ec-04bf-4214-ae38-03d14138f523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:26.764253 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-80fc78ec-04bf-4214-ae38-03d14138f523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:26.781000 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-80fc78ec-04bf-4214-ae38-03d14138f523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Getting quotas for project df862b955995466a84bc189d9098d7ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:15:26.784963 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-80fc78ec-04bf-4214-ae38-03d14138f523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Getting quotas for user 573eab511f4f41b78614247c0f4b99a1 and project df862b955995466a84bc189d9098d7ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:15:26.795846 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-80fc78ec-04bf-4214-ae38-03d14138f523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Going to run 1 instances... {{(pid=117738) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:15:26.798090 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-80fc78ec-04bf-4214-ae38-03d14138f523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19453f68-f52b-45b6-87fc-2c8e0004a353',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:15:26.842931 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-80fc78ec-04bf-4214-ae38-03d14138f523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594921 Jun 16 21:15:26.843779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 144/305] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:15:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:15:26.848233 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b4097b22-e62d-4a81-9c58-c937c3e9b770 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:26.849006 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b4097b22-e62d-4a81-9c58-c937c3e9b770 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:26.855947 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b4097b22-e62d-4a81-9c58-c937c3e9b770 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:26.856434 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b4097b22-e62d-4a81-9c58-c937c3e9b770 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:26.857211 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b4097b22-e62d-4a81-9c58-c937c3e9b770 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:26.857819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b4097b22-e62d-4a81-9c58-c937c3e9b770 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:26.863096 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:26.867583 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5792dba8-e490-4620-879c-48b03bf2a2d9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:26.875729 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5792dba8-e490-4620-879c-48b03bf2a2d9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.158245 Jun 16 21:15:26.876319 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 162/306] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:26 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:26.881851 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-dae91c36-5a20-431a-b464-8df6f5c33c3f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:26.882461 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-dae91c36-5a20-431a-b464-8df6f5c33c3f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:26.937289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-dae91c36-5a20-431a-b464-8df6f5c33c3f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:26.945485 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-dae91c36-5a20-431a-b464-8df6f5c33c3f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1259 microversion: 2.1 time: 0.067736 Jun 16 21:15:26.946076 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 163/307] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:26 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:27.015319 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b4097b22-e62d-4a81-9c58-c937c3e9b770 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:27.023702 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b4097b22-e62d-4a81-9c58-c937c3e9b770 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.179065 Jun 16 21:15:27.024398 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 145/308] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:26 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:27.128715 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-3141f3e9-ff42-4db0-9481-acc53ae2877e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:27.129537 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-3141f3e9-ff42-4db0-9481-acc53ae2877e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:27.153545 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3141f3e9-ff42-4db0-9481-acc53ae2877e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:27.153998 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3141f3e9-ff42-4db0-9481-acc53ae2877e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:27.154784 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3141f3e9-ff42-4db0-9481-acc53ae2877e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:27.155220 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3141f3e9-ff42-4db0-9481-acc53ae2877e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:27.323275 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3141f3e9-ff42-4db0-9481-acc53ae2877e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:27.332012 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3141f3e9-ff42-4db0-9481-acc53ae2877e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:27.333549 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3141f3e9-ff42-4db0-9481-acc53ae2877e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:27.335257 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-3141f3e9-ff42-4db0-9481-acc53ae2877e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1742 microversion: 2.20 time: 0.210470 Jun 16 21:15:27.335812 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 164/309] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:27 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1742 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:27.892290 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-02201e24-6830-437b-bfcc-c26caa76ec65 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:27.892906 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-02201e24-6830-437b-bfcc-c26caa76ec65 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:27.900149 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-02201e24-6830-437b-bfcc-c26caa76ec65 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:27.900652 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-02201e24-6830-437b-bfcc-c26caa76ec65 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:27.901418 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-02201e24-6830-437b-bfcc-c26caa76ec65 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:27.901850 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-02201e24-6830-437b-bfcc-c26caa76ec65 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:27.963634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-522a3a9b-52a4-46da-b56b-7cf6f1bf797d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:27.964430 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-522a3a9b-52a4-46da-b56b-7cf6f1bf797d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:27.971588 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-522a3a9b-52a4-46da-b56b-7cf6f1bf797d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:27.972034 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-522a3a9b-52a4-46da-b56b-7cf6f1bf797d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:27.973027 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-522a3a9b-52a4-46da-b56b-7cf6f1bf797d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:27.973628 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-522a3a9b-52a4-46da-b56b-7cf6f1bf797d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:28.041702 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-522a3a9b-52a4-46da-b56b-7cf6f1bf797d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:28.049825 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-522a3a9b-52a4-46da-b56b-7cf6f1bf797d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1263 microversion: 2.1 time: 0.090847 Jun 16 21:15:28.050397 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 165/310] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:27 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1263 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:28.055307 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-02201e24-6830-437b-bfcc-c26caa76ec65 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:28.055613 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-153fa0c8-a69d-4b1a-b60d-535aa932ff35 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:28.056394 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-153fa0c8-a69d-4b1a-b60d-535aa932ff35 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:28.063111 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-153fa0c8-a69d-4b1a-b60d-535aa932ff35 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:28.063551 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-153fa0c8-a69d-4b1a-b60d-535aa932ff35 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:28.064361 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-153fa0c8-a69d-4b1a-b60d-535aa932ff35 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:28.064792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-153fa0c8-a69d-4b1a-b60d-535aa932ff35 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:28.065890 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-02201e24-6830-437b-bfcc-c26caa76ec65 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.177414 Jun 16 21:15:28.066479 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 146/311] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:27 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:28.202182 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-153fa0c8-a69d-4b1a-b60d-535aa932ff35 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:28.210169 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-153fa0c8-a69d-4b1a-b60d-535aa932ff35 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.158041 Jun 16 21:15:28.210725 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 166/312] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:28 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:28.353798 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-87821d74-549b-4ccd-993a-736f0ae9daec tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:28.354415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-87821d74-549b-4ccd-993a-736f0ae9daec tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:28.360444 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-87821d74-549b-4ccd-993a-736f0ae9daec tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:28.360887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-87821d74-549b-4ccd-993a-736f0ae9daec tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:28.361652 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-87821d74-549b-4ccd-993a-736f0ae9daec tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:28.362347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-87821d74-549b-4ccd-993a-736f0ae9daec tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:28.494882 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-87821d74-549b-4ccd-993a-736f0ae9daec tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:28.502655 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-87821d74-549b-4ccd-993a-736f0ae9daec tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:28.504141 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-87821d74-549b-4ccd-993a-736f0ae9daec tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:28.505301 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-87821d74-549b-4ccd-993a-736f0ae9daec tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1742 microversion: 2.20 time: 0.156012 Jun 16 21:15:28.505846 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 147/313] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:28 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:29.067427 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8c398004-f77d-4345-b2d2-cde23622bc25 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:29.068045 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8c398004-f77d-4345-b2d2-cde23622bc25 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:29.074597 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8c398004-f77d-4345-b2d2-cde23622bc25 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:29.075040 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8c398004-f77d-4345-b2d2-cde23622bc25 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:29.075802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8c398004-f77d-4345-b2d2-cde23622bc25 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:29.077594 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8c398004-f77d-4345-b2d2-cde23622bc25 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:29.082498 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-77990489-cdb8-471a-bcb2-046126e74683 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:29.083111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-77990489-cdb8-471a-bcb2-046126e74683 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:29.090452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-77990489-cdb8-471a-bcb2-046126e74683 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:29.091153 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-77990489-cdb8-471a-bcb2-046126e74683 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:29.092219 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-77990489-cdb8-471a-bcb2-046126e74683 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:29.092656 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-77990489-cdb8-471a-bcb2-046126e74683 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:29.148142 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8c398004-f77d-4345-b2d2-cde23622bc25 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:29.156310 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8c398004-f77d-4345-b2d2-cde23622bc25 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1263 microversion: 2.1 time: 0.092602 Jun 16 21:15:29.157083 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 167/314] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:29 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1263 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:29.229335 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0e687450-2e1e-4ddc-8386-c1001ef71bee tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:29.231315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0e687450-2e1e-4ddc-8386-c1001ef71bee tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:29.238304 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0e687450-2e1e-4ddc-8386-c1001ef71bee tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:29.238815 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0e687450-2e1e-4ddc-8386-c1001ef71bee tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:29.239638 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0e687450-2e1e-4ddc-8386-c1001ef71bee tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:29.240207 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0e687450-2e1e-4ddc-8386-c1001ef71bee tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:29.324810 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-77990489-cdb8-471a-bcb2-046126e74683 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:29.333352 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-77990489-cdb8-471a-bcb2-046126e74683 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.254476 Jun 16 21:15:29.334688 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 148/315] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:29 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:29.420399 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0e687450-2e1e-4ddc-8386-c1001ef71bee tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:29.430396 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0e687450-2e1e-4ddc-8386-c1001ef71bee tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.206038 Jun 16 21:15:29.432261 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 168/316] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:29 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:29.481385 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-2ea1ede4-8fd1-4e78-aede-2ed9605c56e3 req-9ded753d-f9c0-4c73-b912-4422a680ecf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fe2c1e9-e3e7-437a-b627-53fa261bfe2f", "tag": "6d083cc3-57c5-45ee-8b91-13084586fee3"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:15:29.489957 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-2ea1ede4-8fd1-4e78-aede-2ed9605c56e3 req-9ded753d-f9c0-4c73-b912-4422a680ecf4 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:29.490560 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-2ea1ede4-8fd1-4e78-aede-2ed9605c56e3 req-9ded753d-f9c0-4c73-b912-4422a680ecf4 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:29.502606 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-2ea1ede4-8fd1-4e78-aede-2ed9605c56e3 req-9ded753d-f9c0-4c73-b912-4422a680ecf4 service nova] Creating event network-changed:6d083cc3-57c5-45ee-8b91-13084586fee3 for instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f on hv-cinder-81914 Jun 16 21:15:29.508325 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-2ea1ede4-8fd1-4e78-aede-2ed9605c56e3 req-9ded753d-f9c0-4c73-b912-4422a680ecf4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030729 Jun 16 21:15:29.509073 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 149/317] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:15:29.524320 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-625c9e5e-3d65-416d-8564-932dff13e95e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:29.525028 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-625c9e5e-3d65-416d-8564-932dff13e95e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:29.531338 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-625c9e5e-3d65-416d-8564-932dff13e95e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:29.531862 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-625c9e5e-3d65-416d-8564-932dff13e95e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:29.532747 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-625c9e5e-3d65-416d-8564-932dff13e95e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:29.533252 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-625c9e5e-3d65-416d-8564-932dff13e95e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:29.671260 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-625c9e5e-3d65-416d-8564-932dff13e95e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:29.680194 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-625c9e5e-3d65-416d-8564-932dff13e95e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:29.681700 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-625c9e5e-3d65-416d-8564-932dff13e95e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:29.682859 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-625c9e5e-3d65-416d-8564-932dff13e95e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1742 microversion: 2.20 time: 0.163204 Jun 16 21:15:29.683407 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 169/318] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:29 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:30.174843 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-259aef4e-d794-4101-b3e4-7ca7d5c5c996 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:30.175460 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-259aef4e-d794-4101-b3e4-7ca7d5c5c996 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:30.182678 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-259aef4e-d794-4101-b3e4-7ca7d5c5c996 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:30.183123 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-259aef4e-d794-4101-b3e4-7ca7d5c5c996 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:30.183880 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-259aef4e-d794-4101-b3e4-7ca7d5c5c996 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:30.184348 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-259aef4e-d794-4101-b3e4-7ca7d5c5c996 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:30.249073 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-259aef4e-d794-4101-b3e4-7ca7d5c5c996 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:30.256670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-259aef4e-d794-4101-b3e4-7ca7d5c5c996 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1311 microversion: 2.1 time: 0.086506 Jun 16 21:15:30.257207 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 150/319] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:30 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:30.350867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-93084870-42dc-4642-8912-b972c16d3f75 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:30.351548 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-93084870-42dc-4642-8912-b972c16d3f75 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:30.358176 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-93084870-42dc-4642-8912-b972c16d3f75 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:30.358612 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-93084870-42dc-4642-8912-b972c16d3f75 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:30.359365 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-93084870-42dc-4642-8912-b972c16d3f75 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:30.359795 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-93084870-42dc-4642-8912-b972c16d3f75 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:30.393730 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=100 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:30.447302 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-62d40d40-6791-4a9b-9128-cbfebb7a3396 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:30.447977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-62d40d40-6791-4a9b-9128-cbfebb7a3396 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:30.462555 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-62d40d40-6791-4a9b-9128-cbfebb7a3396 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:30.463153 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-62d40d40-6791-4a9b-9128-cbfebb7a3396 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:30.470641 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-62d40d40-6791-4a9b-9128-cbfebb7a3396 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:30.471225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-62d40d40-6791-4a9b-9128-cbfebb7a3396 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:30.475977 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:30.581837 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-93084870-42dc-4642-8912-b972c16d3f75 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:30.591800 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-93084870-42dc-4642-8912-b972c16d3f75 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.245550 Jun 16 21:15:30.605178 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 170/320] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:30 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:30.701195 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-265d14cf-1b6b-4b7c-9b55-58934b4c5a89 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:30.701806 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-265d14cf-1b6b-4b7c-9b55-58934b4c5a89 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:30.708005 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:30.710732 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-265d14cf-1b6b-4b7c-9b55-58934b4c5a89 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:30.711547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-265d14cf-1b6b-4b7c-9b55-58934b4c5a89 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:30.712800 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-265d14cf-1b6b-4b7c-9b55-58934b4c5a89 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:30.713585 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-265d14cf-1b6b-4b7c-9b55-58934b4c5a89 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:30.861466 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-265d14cf-1b6b-4b7c-9b55-58934b4c5a89 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:30.869874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-265d14cf-1b6b-4b7c-9b55-58934b4c5a89 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:30.871354 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-265d14cf-1b6b-4b7c-9b55-58934b4c5a89 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:30.872544 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-265d14cf-1b6b-4b7c-9b55-58934b4c5a89 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1737 microversion: 2.20 time: 0.175355 Jun 16 21:15:30.873078 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 171/321] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:30 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:15:30.885847 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-62d40d40-6791-4a9b-9128-cbfebb7a3396 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:30.893481 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-62d40d40-6791-4a9b-9128-cbfebb7a3396 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.450638 Jun 16 21:15:30.894035 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 151/322] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:30 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:31.275221 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e1329992-fdc3-40a8-b082-834530f83c11 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:31.275824 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e1329992-fdc3-40a8-b082-834530f83c11 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:31.281801 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e1329992-fdc3-40a8-b082-834530f83c11 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:31.282236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e1329992-fdc3-40a8-b082-834530f83c11 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:31.282977 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e1329992-fdc3-40a8-b082-834530f83c11 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:31.283400 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e1329992-fdc3-40a8-b082-834530f83c11 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:31.343077 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e1329992-fdc3-40a8-b082-834530f83c11 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:31.351069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e1329992-fdc3-40a8-b082-834530f83c11 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1317 microversion: 2.1 time: 0.081017 Jun 16 21:15:31.351688 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 172/323] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:31 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1317 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:31.609727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6858dbb3-2180-4537-8d4e-e1b53e2d1da3 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:31.610474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6858dbb3-2180-4537-8d4e-e1b53e2d1da3 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:31.619017 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6858dbb3-2180-4537-8d4e-e1b53e2d1da3 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:31.619803 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6858dbb3-2180-4537-8d4e-e1b53e2d1da3 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:31.620865 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6858dbb3-2180-4537-8d4e-e1b53e2d1da3 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:31.621300 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6858dbb3-2180-4537-8d4e-e1b53e2d1da3 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:31.758030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6858dbb3-2180-4537-8d4e-e1b53e2d1da3 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:31.766098 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6858dbb3-2180-4537-8d4e-e1b53e2d1da3 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.160725 Jun 16 21:15:31.766663 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 152/324] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:31 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:31.882239 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-4543401f-d4e0-4e97-9264-aaee8c50fa09 req-3b73467c-429d-4114-ab5c-f67a7a90fb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2281b8c3-ec1f-478b-bd50-128d5cf67a04", "name": "network-vif-plugged", "status": "completed", "tag": "6473309c-d2e4-42b4-94b1-6b373a5e59f2"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:15:31.891779 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-4543401f-d4e0-4e97-9264-aaee8c50fa09 req-3b73467c-429d-4114-ab5c-f67a7a90fb43 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:31.892254 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-4543401f-d4e0-4e97-9264-aaee8c50fa09 req-3b73467c-429d-4114-ab5c-f67a7a90fb43 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:31.892455 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a12ef0cc-19e6-46f3-bb97-29a13f2699b2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:31.893240 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a12ef0cc-19e6-46f3-bb97-29a13f2699b2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:31.903745 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a12ef0cc-19e6-46f3-bb97-29a13f2699b2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:31.904444 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a12ef0cc-19e6-46f3-bb97-29a13f2699b2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:31.905593 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a12ef0cc-19e6-46f3-bb97-29a13f2699b2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:31.906255 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a12ef0cc-19e6-46f3-bb97-29a13f2699b2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:31.907230 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-4543401f-d4e0-4e97-9264-aaee8c50fa09 req-3b73467c-429d-4114-ab5c-f67a7a90fb43 service nova] Creating event network-vif-plugged:6473309c-d2e4-42b4-94b1-6b373a5e59f2 for instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 on hv-cinder-81914 Jun 16 21:15:31.912549 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-4543401f-d4e0-4e97-9264-aaee8c50fa09 req-3b73467c-429d-4114-ab5c-f67a7a90fb43 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034623 Jun 16 21:15:31.913363 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 173/325] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:15:31.918764 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e2eb03ca-1df2-433b-8719-c5d200f53c7f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:31.919446 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e2eb03ca-1df2-433b-8719-c5d200f53c7f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:31.926148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e2eb03ca-1df2-433b-8719-c5d200f53c7f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:31.926710 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e2eb03ca-1df2-433b-8719-c5d200f53c7f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:31.927645 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e2eb03ca-1df2-433b-8719-c5d200f53c7f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:31.928973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e2eb03ca-1df2-433b-8719-c5d200f53c7f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:32.042974 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a12ef0cc-19e6-46f3-bb97-29a13f2699b2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:32.050850 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a12ef0cc-19e6-46f3-bb97-29a13f2699b2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:32.052394 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a12ef0cc-19e6-46f3-bb97-29a13f2699b2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:32.054212 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a12ef0cc-19e6-46f3-bb97-29a13f2699b2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1737 microversion: 2.20 time: 0.166587 Jun 16 21:15:32.054758 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 153/326] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:31 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:15:32.064648 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e2eb03ca-1df2-433b-8719-c5d200f53c7f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:32.072804 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e2eb03ca-1df2-433b-8719-c5d200f53c7f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.158211 Jun 16 21:15:32.073358 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 174/327] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:31 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:32.369157 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7b170228-c041-4807-9cbb-33602668b689 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:32.369762 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7b170228-c041-4807-9cbb-33602668b689 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:32.375709 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7b170228-c041-4807-9cbb-33602668b689 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:32.376155 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7b170228-c041-4807-9cbb-33602668b689 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:32.376943 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7b170228-c041-4807-9cbb-33602668b689 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:32.377373 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7b170228-c041-4807-9cbb-33602668b689 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:32.438072 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-7b170228-c041-4807-9cbb-33602668b689 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:32.445355 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7b170228-c041-4807-9cbb-33602668b689 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1317 microversion: 2.1 time: 0.080935 Jun 16 21:15:32.445931 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 154/328] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:32 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1317 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:32.783481 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4c7c1282-be24-4098-a476-e9bc2f570a7e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:32.784126 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4c7c1282-be24-4098-a476-e9bc2f570a7e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:32.790563 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4c7c1282-be24-4098-a476-e9bc2f570a7e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:32.791004 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4c7c1282-be24-4098-a476-e9bc2f570a7e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:32.791759 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4c7c1282-be24-4098-a476-e9bc2f570a7e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:32.792195 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4c7c1282-be24-4098-a476-e9bc2f570a7e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:32.923717 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4c7c1282-be24-4098-a476-e9bc2f570a7e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:32.931862 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4c7c1282-be24-4098-a476-e9bc2f570a7e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.152219 Jun 16 21:15:32.932449 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 175/329] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:32 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:33.074587 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1c68b6a6-33f2-4891-a259-52e6f9cfc2fb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:33.075198 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1c68b6a6-33f2-4891-a259-52e6f9cfc2fb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:33.081677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1c68b6a6-33f2-4891-a259-52e6f9cfc2fb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:33.082150 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1c68b6a6-33f2-4891-a259-52e6f9cfc2fb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:33.082931 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1c68b6a6-33f2-4891-a259-52e6f9cfc2fb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:33.083360 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1c68b6a6-33f2-4891-a259-52e6f9cfc2fb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:33.089498 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-bb7ff42b-eb3d-4be0-a13a-6ec9d6b05d52 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:33.090111 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-bb7ff42b-eb3d-4be0-a13a-6ec9d6b05d52 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:33.095996 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bb7ff42b-eb3d-4be0-a13a-6ec9d6b05d52 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:33.096475 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bb7ff42b-eb3d-4be0-a13a-6ec9d6b05d52 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:33.097236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bb7ff42b-eb3d-4be0-a13a-6ec9d6b05d52 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:33.097668 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bb7ff42b-eb3d-4be0-a13a-6ec9d6b05d52 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:33.217078 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1c68b6a6-33f2-4891-a259-52e6f9cfc2fb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:33.225500 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1c68b6a6-33f2-4891-a259-52e6f9cfc2fb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:33.227011 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1c68b6a6-33f2-4891-a259-52e6f9cfc2fb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:33.228188 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1c68b6a6-33f2-4891-a259-52e6f9cfc2fb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1737 microversion: 2.20 time: 0.159719 Jun 16 21:15:33.228746 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 155/330] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:33 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:33.231016 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bb7ff42b-eb3d-4be0-a13a-6ec9d6b05d52 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:33.238814 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-bb7ff42b-eb3d-4be0-a13a-6ec9d6b05d52 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.153312 Jun 16 21:15:33.239367 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 176/331] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:33 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:33.462667 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1fcf0715-926c-4c13-a5b3-dcea3b90a724 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:33.463198 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1fcf0715-926c-4c13-a5b3-dcea3b90a724 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:33.469232 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1fcf0715-926c-4c13-a5b3-dcea3b90a724 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:33.469675 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1fcf0715-926c-4c13-a5b3-dcea3b90a724 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:33.470429 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1fcf0715-926c-4c13-a5b3-dcea3b90a724 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:33.470861 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1fcf0715-926c-4c13-a5b3-dcea3b90a724 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:33.531285 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1fcf0715-926c-4c13-a5b3-dcea3b90a724 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:33.539286 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1fcf0715-926c-4c13-a5b3-dcea3b90a724 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1317 microversion: 2.1 time: 0.081052 Jun 16 21:15:33.539847 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 156/332] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:33 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1317 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:33.948493 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8b8b2f93-c35c-4ee5-8cc4-79ff99e039bc tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:33.949305 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8b8b2f93-c35c-4ee5-8cc4-79ff99e039bc tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:33.960920 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8b8b2f93-c35c-4ee5-8cc4-79ff99e039bc tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:33.961364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8b8b2f93-c35c-4ee5-8cc4-79ff99e039bc tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:33.962460 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8b8b2f93-c35c-4ee5-8cc4-79ff99e039bc tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:33.963175 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8b8b2f93-c35c-4ee5-8cc4-79ff99e039bc tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:34.184531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8b8b2f93-c35c-4ee5-8cc4-79ff99e039bc tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:34.193993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8b8b2f93-c35c-4ee5-8cc4-79ff99e039bc tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.249173 Jun 16 21:15:34.196088 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 177/333] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:33 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:34.247314 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c3d64d9e-ccb7-4135-8bf1-915fc80d8125 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:34.249177 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c3d64d9e-ccb7-4135-8bf1-915fc80d8125 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:34.257360 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-53917690-d7b1-4dc0-bb01-b014cc5fdc13 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:34.258423 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-53917690-d7b1-4dc0-bb01-b014cc5fdc13 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:34.276781 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-53917690-d7b1-4dc0-bb01-b014cc5fdc13 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:34.277117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c3d64d9e-ccb7-4135-8bf1-915fc80d8125 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:34.277701 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-53917690-d7b1-4dc0-bb01-b014cc5fdc13 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:34.278485 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-53917690-d7b1-4dc0-bb01-b014cc5fdc13 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:34.278961 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-53917690-d7b1-4dc0-bb01-b014cc5fdc13 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:34.279590 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c3d64d9e-ccb7-4135-8bf1-915fc80d8125 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:34.280422 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c3d64d9e-ccb7-4135-8bf1-915fc80d8125 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:34.280849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c3d64d9e-ccb7-4135-8bf1-915fc80d8125 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:34.532575 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-53917690-d7b1-4dc0-bb01-b014cc5fdc13 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:34.544030 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-53917690-d7b1-4dc0-bb01-b014cc5fdc13 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.289945 Jun 16 21:15:34.545194 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 178/334] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:34 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:34.559431 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-3270e535-b951-4097-87ce-24e80f8c2041 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:34.562450 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-3270e535-b951-4097-87ce-24e80f8c2041 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:34.575160 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3270e535-b951-4097-87ce-24e80f8c2041 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:34.576342 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3270e535-b951-4097-87ce-24e80f8c2041 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:34.577449 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3270e535-b951-4097-87ce-24e80f8c2041 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:34.578063 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3270e535-b951-4097-87ce-24e80f8c2041 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:34.611318 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c3d64d9e-ccb7-4135-8bf1-915fc80d8125 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:34.640747 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c3d64d9e-ccb7-4135-8bf1-915fc80d8125 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:34.642170 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c3d64d9e-ccb7-4135-8bf1-915fc80d8125 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:34.655846 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c3d64d9e-ccb7-4135-8bf1-915fc80d8125 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1737 microversion: 2.20 time: 0.412395 Jun 16 21:15:34.667766 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 157/335] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:34 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1737 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:34.839975 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3270e535-b951-4097-87ce-24e80f8c2041 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:34.856768 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-3270e535-b951-4097-87ce-24e80f8c2041 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.304745 Jun 16 21:15:34.870745 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 179/336] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:34 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:35.213088 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-e1a175bb-74ee-4db8-a667-7a22cb0355c0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:35.213918 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-e1a175bb-74ee-4db8-a667-7a22cb0355c0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:35.228835 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e1a175bb-74ee-4db8-a667-7a22cb0355c0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:35.229277 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e1a175bb-74ee-4db8-a667-7a22cb0355c0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:35.230044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e1a175bb-74ee-4db8-a667-7a22cb0355c0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:35.230468 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e1a175bb-74ee-4db8-a667-7a22cb0355c0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:35.560942 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-efa81165-675f-47ac-9723-9044ae8bd329 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:35.561490 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-efa81165-675f-47ac-9723-9044ae8bd329 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:35.608096 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-efa81165-675f-47ac-9723-9044ae8bd329 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:35.609597 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-efa81165-675f-47ac-9723-9044ae8bd329 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:35.617225 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-efa81165-675f-47ac-9723-9044ae8bd329 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:35.617676 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-efa81165-675f-47ac-9723-9044ae8bd329 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:35.643505 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-e1a175bb-74ee-4db8-a667-7a22cb0355c0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:35.663437 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-e1a175bb-74ee-4db8-a667-7a22cb0355c0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.450657 Jun 16 21:15:35.664891 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 158/337] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:35 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:35.686658 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0c72b343-ccfb-486d-9dca-7394d8b01ce1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:35.689202 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0c72b343-ccfb-486d-9dca-7394d8b01ce1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:35.707365 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0c72b343-ccfb-486d-9dca-7394d8b01ce1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:35.707827 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0c72b343-ccfb-486d-9dca-7394d8b01ce1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:35.708633 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0c72b343-ccfb-486d-9dca-7394d8b01ce1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:35.709074 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0c72b343-ccfb-486d-9dca-7394d8b01ce1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:35.847542 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-efa81165-675f-47ac-9723-9044ae8bd329 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:35.863367 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-efa81165-675f-47ac-9723-9044ae8bd329 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.305202 Jun 16 21:15:35.866437 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 180/338] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:35 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:35.886249 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5d5c85cf-ba63-45e7-9fc6-2098d8d267c1 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:35.887458 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5d5c85cf-ba63-45e7-9fc6-2098d8d267c1 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:35.896588 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5d5c85cf-ba63-45e7-9fc6-2098d8d267c1 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:35.899112 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5d5c85cf-ba63-45e7-9fc6-2098d8d267c1 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:35.900389 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5d5c85cf-ba63-45e7-9fc6-2098d8d267c1 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:35.900996 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5d5c85cf-ba63-45e7-9fc6-2098d8d267c1 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:36.253079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5d5c85cf-ba63-45e7-9fc6-2098d8d267c1 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:36.266312 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5d5c85cf-ba63-45e7-9fc6-2098d8d267c1 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.393375 Jun 16 21:15:36.269521 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 181/339] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:35 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:36.275938 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b4eeae3b-60d2-4696-b91d-a7754813fc0e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:15:36.298237 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b4eeae3b-60d2-4696-b91d-a7754813fc0e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:36.298957 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b4eeae3b-60d2-4696-b91d-a7754813fc0e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:36.346087 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0c72b343-ccfb-486d-9dca-7394d8b01ce1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:36.369896 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0c72b343-ccfb-486d-9dca-7394d8b01ce1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:36.371707 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0c72b343-ccfb-486d-9dca-7394d8b01ce1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:36.373795 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0c72b343-ccfb-486d-9dca-7394d8b01ce1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1737 microversion: 2.20 time: 0.695828 Jun 16 21:15:36.390418 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 159/340] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:35 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1737 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:15:36.428698 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b4eeae3b-60d2-4696-b91d-a7754813fc0e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Going to try to stop instance {{(pid=117737) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 21:15:36.552209 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b4eeae3b-60d2-4696-b91d-a7754813fc0e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "POST /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/action" status: 202 len: 0 microversion: 2.1 time: 0.281210 Jun 16 21:15:36.553676 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 182/341] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 16 21:15:36 2022] POST /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:15:36.563586 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-abd77757-ffc9-4bb0-aecf-26bcd67846a5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:36.564910 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-abd77757-ffc9-4bb0-aecf-26bcd67846a5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:36.576674 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-abd77757-ffc9-4bb0-aecf-26bcd67846a5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:36.577338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-abd77757-ffc9-4bb0-aecf-26bcd67846a5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:36.578281 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-abd77757-ffc9-4bb0-aecf-26bcd67846a5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:36.578774 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-abd77757-ffc9-4bb0-aecf-26bcd67846a5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:36.683243 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b1503a97-cb79-4f38-806a-6f88f8a407ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:36.684639 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b1503a97-cb79-4f38-806a-6f88f8a407ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:36.699901 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b1503a97-cb79-4f38-806a-6f88f8a407ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:36.705364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b1503a97-cb79-4f38-806a-6f88f8a407ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:36.706575 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b1503a97-cb79-4f38-806a-6f88f8a407ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:36.707265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b1503a97-cb79-4f38-806a-6f88f8a407ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:36.770575 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=2 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:36.792377 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=8 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:36.942438 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=16 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:37.009584 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-abd77757-ffc9-4bb0-aecf-26bcd67846a5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:37.019923 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-abd77757-ffc9-4bb0-aecf-26bcd67846a5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.461785 Jun 16 21:15:37.022100 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b1503a97-cb79-4f38-806a-6f88f8a407ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:37.026790 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 160/342] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:36 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:37.030029 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b1503a97-cb79-4f38-806a-6f88f8a407ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.351006 Jun 16 21:15:37.030599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 183/343] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:36 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:37.033274 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-68de14fe-3563-4799-b65e-4372e0b4dd64 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:37.034124 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-68de14fe-3563-4799-b65e-4372e0b4dd64 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:37.045646 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-68de14fe-3563-4799-b65e-4372e0b4dd64 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:37.046360 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-68de14fe-3563-4799-b65e-4372e0b4dd64 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:37.047300 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-68de14fe-3563-4799-b65e-4372e0b4dd64 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:37.047889 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-68de14fe-3563-4799-b65e-4372e0b4dd64 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:37.048468 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-819f5765-92be-4802-a7d1-82fbe5478eab req-12436e7d-03a0-4061-be3a-515a5578c4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec1e2cd-9bb8-4602-9f96-77478cfc9af8", "tag": "f26fce3f-5e61-4002-98b6-275c3b72e9db"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:15:37.068274 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-819f5765-92be-4802-a7d1-82fbe5478eab req-12436e7d-03a0-4061-be3a-515a5578c4d8 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:37.070393 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-819f5765-92be-4802-a7d1-82fbe5478eab req-12436e7d-03a0-4061-be3a-515a5578c4d8 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:37.097868 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-819f5765-92be-4802-a7d1-82fbe5478eab req-12436e7d-03a0-4061-be3a-515a5578c4d8 service nova] Creating event network-changed:f26fce3f-5e61-4002-98b6-275c3b72e9db for instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 on hv-cinder-81914 Jun 16 21:15:37.103061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-819f5765-92be-4802-a7d1-82fbe5478eab req-12436e7d-03a0-4061-be3a-515a5578c4d8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062102 Jun 16 21:15:37.104367 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 184/344] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:15:37.275484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-68de14fe-3563-4799-b65e-4372e0b4dd64 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:37.285479 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-75b68a82-ef4a-4476-9af7-d62b9b326076 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:37.286173 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-75b68a82-ef4a-4476-9af7-d62b9b326076 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:37.298269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-68de14fe-3563-4799-b65e-4372e0b4dd64 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.269654 Jun 16 21:15:37.299178 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 161/345] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:37 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:37.316293 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-75b68a82-ef4a-4476-9af7-d62b9b326076 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:37.317011 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-75b68a82-ef4a-4476-9af7-d62b9b326076 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:37.318013 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-75b68a82-ef4a-4476-9af7-d62b9b326076 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:37.318938 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-75b68a82-ef4a-4476-9af7-d62b9b326076 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:37.394781 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d51c0c95-38db-435c-9503-51817a8d41c7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:37.395442 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d51c0c95-38db-435c-9503-51817a8d41c7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:37.411862 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d51c0c95-38db-435c-9503-51817a8d41c7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:37.412805 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d51c0c95-38db-435c-9503-51817a8d41c7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:37.413969 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d51c0c95-38db-435c-9503-51817a8d41c7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:37.414677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d51c0c95-38db-435c-9503-51817a8d41c7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:37.434118 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=100 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:37.510287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-75b68a82-ef4a-4476-9af7-d62b9b326076 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:37.518103 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-75b68a82-ef4a-4476-9af7-d62b9b326076 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.237733 Jun 16 21:15:37.524213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 185/346] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:37 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:37.588554 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d51c0c95-38db-435c-9503-51817a8d41c7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:37.613416 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d51c0c95-38db-435c-9503-51817a8d41c7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:37.615349 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d51c0c95-38db-435c-9503-51817a8d41c7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:37.617217 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d51c0c95-38db-435c-9503-51817a8d41c7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1737 microversion: 2.20 time: 0.226949 Jun 16 21:15:37.617776 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 162/347] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:37 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1737 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:38.049643 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4bc9dbf6-d0c2-4522-a426-25e0440ba7b6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:38.050713 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4bc9dbf6-d0c2-4522-a426-25e0440ba7b6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:38.058620 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-977f591b-ed1b-40fc-8908-f6a325ad054f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:38.059710 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-977f591b-ed1b-40fc-8908-f6a325ad054f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:38.064297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:38.070802 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4bc9dbf6-d0c2-4522-a426-25e0440ba7b6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:38.070802 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4bc9dbf6-d0c2-4522-a426-25e0440ba7b6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:38.071123 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-977f591b-ed1b-40fc-8908-f6a325ad054f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:38.071239 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4bc9dbf6-d0c2-4522-a426-25e0440ba7b6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:38.071322 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-977f591b-ed1b-40fc-8908-f6a325ad054f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:38.071512 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4bc9dbf6-d0c2-4522-a426-25e0440ba7b6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:38.072395 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-977f591b-ed1b-40fc-8908-f6a325ad054f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:38.073418 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-977f591b-ed1b-40fc-8908-f6a325ad054f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:38.250107 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4bc9dbf6-d0c2-4522-a426-25e0440ba7b6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:38.254524 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-977f591b-ed1b-40fc-8908-f6a325ad054f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:38.260958 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4bc9dbf6-d0c2-4522-a426-25e0440ba7b6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.217389 Jun 16 21:15:38.261896 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 163/348] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:38 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:38.265235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-977f591b-ed1b-40fc-8908-f6a325ad054f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.225486 Jun 16 21:15:38.266036 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 186/349] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:38 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:38.316312 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5ff8b0cf-d058-4509-bba1-a42a250fc639 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:38.317034 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5ff8b0cf-d058-4509-bba1-a42a250fc639 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:38.323316 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5ff8b0cf-d058-4509-bba1-a42a250fc639 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:38.323839 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5ff8b0cf-d058-4509-bba1-a42a250fc639 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:38.324715 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5ff8b0cf-d058-4509-bba1-a42a250fc639 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:38.325350 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5ff8b0cf-d058-4509-bba1-a42a250fc639 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:38.472600 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5ff8b0cf-d058-4509-bba1-a42a250fc639 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:38.481589 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5ff8b0cf-d058-4509-bba1-a42a250fc639 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.169288 Jun 16 21:15:38.482396 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 164/350] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:38 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:38.540733 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-08f8f2bd-6c6d-47ea-9964-e13f0b474e9e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:38.544438 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-08f8f2bd-6c6d-47ea-9964-e13f0b474e9e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:38.550918 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-08f8f2bd-6c6d-47ea-9964-e13f0b474e9e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:38.551849 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-08f8f2bd-6c6d-47ea-9964-e13f0b474e9e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:38.553750 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-08f8f2bd-6c6d-47ea-9964-e13f0b474e9e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:38.554394 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-08f8f2bd-6c6d-47ea-9964-e13f0b474e9e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:38.575567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:38.639945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-997e7f7e-d0e2-4a81-a2ae-f8911ac82f80 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:38.640736 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-997e7f7e-d0e2-4a81-a2ae-f8911ac82f80 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:38.651798 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-997e7f7e-d0e2-4a81-a2ae-f8911ac82f80 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:38.652653 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-997e7f7e-d0e2-4a81-a2ae-f8911ac82f80 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:38.653972 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-997e7f7e-d0e2-4a81-a2ae-f8911ac82f80 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:38.654638 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-997e7f7e-d0e2-4a81-a2ae-f8911ac82f80 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:38.737771 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-08f8f2bd-6c6d-47ea-9964-e13f0b474e9e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:38.746029 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-08f8f2bd-6c6d-47ea-9964-e13f0b474e9e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.214074 Jun 16 21:15:38.749509 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 187/351] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:38 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:38.822306 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-997e7f7e-d0e2-4a81-a2ae-f8911ac82f80 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:38.830819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-997e7f7e-d0e2-4a81-a2ae-f8911ac82f80 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:38.832463 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-997e7f7e-d0e2-4a81-a2ae-f8911ac82f80 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:38.833689 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-997e7f7e-d0e2-4a81-a2ae-f8911ac82f80 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1737 microversion: 2.20 time: 0.199412 Jun 16 21:15:38.835523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 165/352] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:38 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:15:39.288904 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-442c3bef-a9a9-4d36-9c94-02853cb71cca tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:39.290003 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c9d3d225-d9b0-47a9-bff8-5a2b73607ec6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:39.290716 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-442c3bef-a9a9-4d36-9c94-02853cb71cca tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:39.293467 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c9d3d225-d9b0-47a9-bff8-5a2b73607ec6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:39.324361 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-442c3bef-a9a9-4d36-9c94-02853cb71cca tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:39.326702 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-442c3bef-a9a9-4d36-9c94-02853cb71cca tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:39.327781 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c9d3d225-d9b0-47a9-bff8-5a2b73607ec6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:39.328249 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c9d3d225-d9b0-47a9-bff8-5a2b73607ec6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:39.329027 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c9d3d225-d9b0-47a9-bff8-5a2b73607ec6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:39.329296 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-442c3bef-a9a9-4d36-9c94-02853cb71cca tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:39.329475 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c9d3d225-d9b0-47a9-bff8-5a2b73607ec6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:39.330603 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-442c3bef-a9a9-4d36-9c94-02853cb71cca tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:39.714403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c9d3d225-d9b0-47a9-bff8-5a2b73607ec6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:39.722720 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c9d3d225-d9b0-47a9-bff8-5a2b73607ec6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.440130 Jun 16 21:15:39.723329 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-442c3bef-a9a9-4d36-9c94-02853cb71cca tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:39.724055 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 166/353] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:39 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:39.731151 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c37233ed-60a9-4291-a2e1-7c79d7e467f2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:39.732020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c37233ed-60a9-4291-a2e1-7c79d7e467f2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:39.735323 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-442c3bef-a9a9-4d36-9c94-02853cb71cca tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.460847 Jun 16 21:15:39.736454 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 188/354] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:39 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:39.739971 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c37233ed-60a9-4291-a2e1-7c79d7e467f2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:39.740402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c37233ed-60a9-4291-a2e1-7c79d7e467f2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:39.742037 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c37233ed-60a9-4291-a2e1-7c79d7e467f2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:39.742466 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c37233ed-60a9-4291-a2e1-7c79d7e467f2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:39.766646 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0ccbbae8-eca0-4ae7-b086-ae0c4a39ad20 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:39.767556 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0ccbbae8-eca0-4ae7-b086-ae0c4a39ad20 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:39.777311 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0ccbbae8-eca0-4ae7-b086-ae0c4a39ad20 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:39.777873 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0ccbbae8-eca0-4ae7-b086-ae0c4a39ad20 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:39.778809 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0ccbbae8-eca0-4ae7-b086-ae0c4a39ad20 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:39.779375 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0ccbbae8-eca0-4ae7-b086-ae0c4a39ad20 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:39.942539 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c37233ed-60a9-4291-a2e1-7c79d7e467f2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:39.967852 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c37233ed-60a9-4291-a2e1-7c79d7e467f2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.239244 Jun 16 21:15:39.971750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 167/355] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:39 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:39.982953 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-69ad40d7-fead-4e40-b4d4-35b20ea88c3c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:39.983938 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-69ad40d7-fead-4e40-b4d4-35b20ea88c3c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:39.993160 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-69ad40d7-fead-4e40-b4d4-35b20ea88c3c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:39.994125 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-69ad40d7-fead-4e40-b4d4-35b20ea88c3c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:39.995352 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-69ad40d7-fead-4e40-b4d4-35b20ea88c3c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:39.996006 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-69ad40d7-fead-4e40-b4d4-35b20ea88c3c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:40.208774 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0ccbbae8-eca0-4ae7-b086-ae0c4a39ad20 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:40.219340 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0ccbbae8-eca0-4ae7-b086-ae0c4a39ad20 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.457149 Jun 16 21:15:40.220077 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 189/356] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:39 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:40.314055 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-69ad40d7-fead-4e40-b4d4-35b20ea88c3c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:40.323840 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-69ad40d7-fead-4e40-b4d4-35b20ea88c3c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:40.325552 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-69ad40d7-fead-4e40-b4d4-35b20ea88c3c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:40.326846 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-69ad40d7-fead-4e40-b4d4-35b20ea88c3c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1737 microversion: 2.20 time: 0.352491 Jun 16 21:15:40.327807 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 168/357] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:39 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1737 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:40.757438 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-41050f78-c2a7-4962-ae0c-3b89d90537e6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:40.758098 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c4a9cdf2-6947-4161-82c7-d77f7abf0f36 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:40.758226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-41050f78-c2a7-4962-ae0c-3b89d90537e6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:40.758733 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c4a9cdf2-6947-4161-82c7-d77f7abf0f36 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:40.775460 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c4a9cdf2-6947-4161-82c7-d77f7abf0f36 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:40.777278 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c4a9cdf2-6947-4161-82c7-d77f7abf0f36 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:40.779231 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-41050f78-c2a7-4962-ae0c-3b89d90537e6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:40.780505 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c4a9cdf2-6947-4161-82c7-d77f7abf0f36 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:40.781193 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c4a9cdf2-6947-4161-82c7-d77f7abf0f36 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:40.781931 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-41050f78-c2a7-4962-ae0c-3b89d90537e6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:40.796985 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-41050f78-c2a7-4962-ae0c-3b89d90537e6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:40.799525 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-41050f78-c2a7-4962-ae0c-3b89d90537e6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:41.067653 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c4a9cdf2-6947-4161-82c7-d77f7abf0f36 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:41.076648 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c4a9cdf2-6947-4161-82c7-d77f7abf0f36 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.323936 Jun 16 21:15:41.085852 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-41050f78-c2a7-4962-ae0c-3b89d90537e6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:41.098339 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-41050f78-c2a7-4962-ae0c-3b89d90537e6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.361067 Jun 16 21:15:41.098586 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 169/358] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:40 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:41.103728 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a9de8ce5-67ed-4462-adac-72caf85098b8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:41.113361 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a9de8ce5-67ed-4462-adac-72caf85098b8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:41.113361 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a9de8ce5-67ed-4462-adac-72caf85098b8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:41.115264 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a9de8ce5-67ed-4462-adac-72caf85098b8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:41.116257 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 190/359] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:40 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:41.120246 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a9de8ce5-67ed-4462-adac-72caf85098b8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:41.120942 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a9de8ce5-67ed-4462-adac-72caf85098b8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:41.238617 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-16d6ab3f-399f-4213-9c4d-14a292d1b34d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:41.239511 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-16d6ab3f-399f-4213-9c4d-14a292d1b34d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:41.249698 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-16d6ab3f-399f-4213-9c4d-14a292d1b34d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:41.250892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-16d6ab3f-399f-4213-9c4d-14a292d1b34d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:41.252482 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-16d6ab3f-399f-4213-9c4d-14a292d1b34d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:41.253091 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-16d6ab3f-399f-4213-9c4d-14a292d1b34d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:41.329665 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a9de8ce5-67ed-4462-adac-72caf85098b8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:41.343503 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a9de8ce5-67ed-4462-adac-72caf85098b8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.243435 Jun 16 21:15:41.344337 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 170/360] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:41 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:41.349248 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-56f117fe-53d6-4d22-9377-497779e2f293 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:41.350387 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-56f117fe-53d6-4d22-9377-497779e2f293 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:41.359848 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-56f117fe-53d6-4d22-9377-497779e2f293 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:41.360436 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-56f117fe-53d6-4d22-9377-497779e2f293 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:41.361380 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-56f117fe-53d6-4d22-9377-497779e2f293 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:41.361826 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-56f117fe-53d6-4d22-9377-497779e2f293 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:41.476695 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-16d6ab3f-399f-4213-9c4d-14a292d1b34d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:41.489609 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-16d6ab3f-399f-4213-9c4d-14a292d1b34d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.250021 Jun 16 21:15:41.502004 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 191/361] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:41 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:41.635022 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-56f117fe-53d6-4d22-9377-497779e2f293 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:41.651733 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-56f117fe-53d6-4d22-9377-497779e2f293 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:41.657045 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-56f117fe-53d6-4d22-9377-497779e2f293 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:41.659468 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-56f117fe-53d6-4d22-9377-497779e2f293 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1737 microversion: 2.20 time: 0.314361 Jun 16 21:15:41.662426 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 171/362] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:41 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1737 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:42.105079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1b596357-8f63-4c25-b5b5-85b3d23d8472 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:42.112213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1b596357-8f63-4c25-b5b5-85b3d23d8472 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:42.123493 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-509668e1-d26d-459f-8cb0-6c46baefdd0e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:42.124897 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-509668e1-d26d-459f-8cb0-6c46baefdd0e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:42.130182 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1b596357-8f63-4c25-b5b5-85b3d23d8472 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:42.130634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1b596357-8f63-4c25-b5b5-85b3d23d8472 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:42.132000 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1b596357-8f63-4c25-b5b5-85b3d23d8472 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:42.132476 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1b596357-8f63-4c25-b5b5-85b3d23d8472 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:42.135189 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-509668e1-d26d-459f-8cb0-6c46baefdd0e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:42.136677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-509668e1-d26d-459f-8cb0-6c46baefdd0e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:42.138408 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-509668e1-d26d-459f-8cb0-6c46baefdd0e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:42.139072 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-509668e1-d26d-459f-8cb0-6c46baefdd0e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:42.349442 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-509668e1-d26d-459f-8cb0-6c46baefdd0e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:42.360811 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-509668e1-d26d-459f-8cb0-6c46baefdd0e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.241678 Jun 16 21:15:42.362653 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 172/363] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:42 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:42.367770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-07d4c2e0-7887-4ee7-a809-7722f5bfafd4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:42.368413 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-07d4c2e0-7887-4ee7-a809-7722f5bfafd4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:42.391018 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1b596357-8f63-4c25-b5b5-85b3d23d8472 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:42.394989 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-07d4c2e0-7887-4ee7-a809-7722f5bfafd4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:42.395449 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-07d4c2e0-7887-4ee7-a809-7722f5bfafd4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:42.396281 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-07d4c2e0-7887-4ee7-a809-7722f5bfafd4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:42.397500 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-07d4c2e0-7887-4ee7-a809-7722f5bfafd4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:42.399375 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1b596357-8f63-4c25-b5b5-85b3d23d8472 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.298100 Jun 16 21:15:42.414814 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 192/364] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:42 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:42.508411 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b43c3f6e-f041-42c8-9b67-c268a00cd4d2 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:42.509041 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b43c3f6e-f041-42c8-9b67-c268a00cd4d2 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:42.521269 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b43c3f6e-f041-42c8-9b67-c268a00cd4d2 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:42.522319 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b43c3f6e-f041-42c8-9b67-c268a00cd4d2 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:42.523476 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b43c3f6e-f041-42c8-9b67-c268a00cd4d2 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:42.523922 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b43c3f6e-f041-42c8-9b67-c268a00cd4d2 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:42.714560 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-07d4c2e0-7887-4ee7-a809-7722f5bfafd4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:42.767249 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-07d4c2e0-7887-4ee7-a809-7722f5bfafd4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.403450 Jun 16 21:15:42.770275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 173/365] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:42 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:42.779761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-be7908c5-fa0c-415e-8b1f-d51cd6a6a10d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:42.797839 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-be7908c5-fa0c-415e-8b1f-d51cd6a6a10d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:42.817836 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-be7908c5-fa0c-415e-8b1f-d51cd6a6a10d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:42.823109 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-be7908c5-fa0c-415e-8b1f-d51cd6a6a10d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:42.824482 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-be7908c5-fa0c-415e-8b1f-d51cd6a6a10d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:42.825576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-be7908c5-fa0c-415e-8b1f-d51cd6a6a10d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:42.878506 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b43c3f6e-f041-42c8-9b67-c268a00cd4d2 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:42.888623 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b43c3f6e-f041-42c8-9b67-c268a00cd4d2 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.384065 Jun 16 21:15:42.891177 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 193/366] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:42 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:42.897370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7c3c6605-e0c9-4894-8554-078eacebc780 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:42.898118 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7c3c6605-e0c9-4894-8554-078eacebc780 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:42.905328 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7c3c6605-e0c9-4894-8554-078eacebc780 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:42.906137 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7c3c6605-e0c9-4894-8554-078eacebc780 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:42.907369 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7c3c6605-e0c9-4894-8554-078eacebc780 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:42.907964 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7c3c6605-e0c9-4894-8554-078eacebc780 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:43.062558 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-be7908c5-fa0c-415e-8b1f-d51cd6a6a10d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:43.074298 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-be7908c5-fa0c-415e-8b1f-d51cd6a6a10d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:43.076082 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-be7908c5-fa0c-415e-8b1f-d51cd6a6a10d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:43.077393 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-be7908c5-fa0c-415e-8b1f-d51cd6a6a10d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1737 microversion: 2.20 time: 0.306193 Jun 16 21:15:43.078075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 174/367] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:42 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1737 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:43.184890 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.objects.instance [None req-7c3c6605-e0c9-4894-8554-078eacebc780 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lazy-loading 'services' on Instance uuid 1203965c-d902-4af7-99a1-308d7d5a6159 {{(pid=117737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:15:43.366459 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7c3c6605-e0c9-4894-8554-078eacebc780 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159/os-volume_attachments/91fbce58-960d-40a7-903b-407b5d8566d6" status: 202 len: 0 microversion: 2.1 time: 0.473183 Jun 16 21:15:43.370072 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 194/368] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 16 21:15:42 2022] DELETE /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159/os-volume_attachments/91fbce58-960d-40a7-903b-407b5d8566d6 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:15:43.378877 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-ebe76067-aaac-4046-962b-2d266a2691ec tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:43.379498 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-ebe76067-aaac-4046-962b-2d266a2691ec tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:43.394545 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ebe76067-aaac-4046-962b-2d266a2691ec tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:43.395066 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ebe76067-aaac-4046-962b-2d266a2691ec tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:43.395818 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ebe76067-aaac-4046-962b-2d266a2691ec tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:43.396277 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ebe76067-aaac-4046-962b-2d266a2691ec tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:43.420074 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-de254789-20b7-4737-a884-d1a74c518132 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:43.420853 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-de254789-20b7-4737-a884-d1a74c518132 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:43.432052 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-de254789-20b7-4737-a884-d1a74c518132 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:43.432052 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-de254789-20b7-4737-a884-d1a74c518132 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:43.432946 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-de254789-20b7-4737-a884-d1a74c518132 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:43.433349 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-de254789-20b7-4737-a884-d1a74c518132 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:43.675548 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-ebe76067-aaac-4046-962b-2d266a2691ec tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:43.685390 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-ebe76067-aaac-4046-962b-2d266a2691ec tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.309335 Jun 16 21:15:43.686298 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 175/369] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:43 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:43.700949 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-de254789-20b7-4737-a884-d1a74c518132 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:43.717196 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-de254789-20b7-4737-a884-d1a74c518132 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.302944 Jun 16 21:15:43.721664 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 195/370] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:43 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:43.786215 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-56dc4786-776e-4f91-bc56-668332543b6f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:43.786981 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-56dc4786-776e-4f91-bc56-668332543b6f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:43.798058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-56dc4786-776e-4f91-bc56-668332543b6f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:43.800826 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-56dc4786-776e-4f91-bc56-668332543b6f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:43.801716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-56dc4786-776e-4f91-bc56-668332543b6f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:43.801716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-56dc4786-776e-4f91-bc56-668332543b6f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:43.908682 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-fef74a3a-884f-49d4-9cdd-5128b775ab45 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:43.909920 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-fef74a3a-884f-49d4-9cdd-5128b775ab45 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:43.938117 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fef74a3a-884f-49d4-9cdd-5128b775ab45 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:43.938997 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fef74a3a-884f-49d4-9cdd-5128b775ab45 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:43.939785 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fef74a3a-884f-49d4-9cdd-5128b775ab45 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:43.942649 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fef74a3a-884f-49d4-9cdd-5128b775ab45 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:44.042436 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-56dc4786-776e-4f91-bc56-668332543b6f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:44.060546 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-56dc4786-776e-4f91-bc56-668332543b6f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.276582 Jun 16 21:15:44.067239 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 176/371] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:43 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:44.096758 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d5e55f70-760a-4840-8b39-3b558c7a1a01 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:44.097631 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d5e55f70-760a-4840-8b39-3b558c7a1a01 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:44.109456 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d5e55f70-760a-4840-8b39-3b558c7a1a01 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:44.109912 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d5e55f70-760a-4840-8b39-3b558c7a1a01 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:44.110685 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d5e55f70-760a-4840-8b39-3b558c7a1a01 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:44.111173 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d5e55f70-760a-4840-8b39-3b558c7a1a01 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:44.137041 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-fef74a3a-884f-49d4-9cdd-5128b775ab45 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:44.146306 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-fef74a3a-884f-49d4-9cdd-5128b775ab45 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.242661 Jun 16 21:15:44.158031 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 196/372] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:43 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:44.333269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d5e55f70-760a-4840-8b39-3b558c7a1a01 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:44.345497 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d5e55f70-760a-4840-8b39-3b558c7a1a01 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:44.348082 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d5e55f70-760a-4840-8b39-3b558c7a1a01 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:44.350178 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d5e55f70-760a-4840-8b39-3b558c7a1a01 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1737 microversion: 2.20 time: 0.258532 Jun 16 21:15:44.352043 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 177/373] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:44 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1737 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:15:44.523820 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-59b59246-096d-4689-8d0c-86f45e846042 req-ef749616-aeff-42cd-b358-ac4534157dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe2c1e9-e3e7-437a-b627-53fa261bfe2f", "name": "network-vif-plugged", "status": "completed", "tag": "6d083cc3-57c5-45ee-8b91-13084586fee3"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:15:44.550673 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-59b59246-096d-4689-8d0c-86f45e846042 req-ef749616-aeff-42cd-b358-ac4534157dc0 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:44.551124 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-59b59246-096d-4689-8d0c-86f45e846042 req-ef749616-aeff-42cd-b358-ac4534157dc0 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:44.575871 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-59b59246-096d-4689-8d0c-86f45e846042 req-ef749616-aeff-42cd-b358-ac4534157dc0 service nova] Creating event network-vif-plugged:6d083cc3-57c5-45ee-8b91-13084586fee3 for instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f on hv-cinder-81914 Jun 16 21:15:44.594652 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-59b59246-096d-4689-8d0c-86f45e846042 req-ef749616-aeff-42cd-b358-ac4534157dc0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075516 Jun 16 21:15:44.604304 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 197/374] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:15:44.707033 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0b04b194-09df-436b-9dbb-00747b6098ec tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:44.708596 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0b04b194-09df-436b-9dbb-00747b6098ec tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:44.718168 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0b04b194-09df-436b-9dbb-00747b6098ec tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:44.718678 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0b04b194-09df-436b-9dbb-00747b6098ec tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:44.719469 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0b04b194-09df-436b-9dbb-00747b6098ec tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:44.720070 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0b04b194-09df-436b-9dbb-00747b6098ec tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:44.740916 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5c5f0d9d-2b61-4567-a364-82330fefc2ad tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:44.742012 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5c5f0d9d-2b61-4567-a364-82330fefc2ad tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:44.760990 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5c5f0d9d-2b61-4567-a364-82330fefc2ad tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:44.761454 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5c5f0d9d-2b61-4567-a364-82330fefc2ad tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:44.763273 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5c5f0d9d-2b61-4567-a364-82330fefc2ad tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:44.763710 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5c5f0d9d-2b61-4567-a364-82330fefc2ad tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:45.023568 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5c5f0d9d-2b61-4567-a364-82330fefc2ad tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:45.034335 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5c5f0d9d-2b61-4567-a364-82330fefc2ad tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.298992 Jun 16 21:15:45.045296 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 198/375] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:44 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:45.080423 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-12cf637a-2ba8-4d4e-8d7d-fdf392f0f13f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:45.081462 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-12cf637a-2ba8-4d4e-8d7d-fdf392f0f13f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:45.103946 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-12cf637a-2ba8-4d4e-8d7d-fdf392f0f13f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:45.110247 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-12cf637a-2ba8-4d4e-8d7d-fdf392f0f13f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:45.113184 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-12cf637a-2ba8-4d4e-8d7d-fdf392f0f13f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:45.113941 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-12cf637a-2ba8-4d4e-8d7d-fdf392f0f13f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:45.125576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0b04b194-09df-436b-9dbb-00747b6098ec tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:45.148502 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0b04b194-09df-436b-9dbb-00747b6098ec tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.437492 Jun 16 21:15:45.149791 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 178/376] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:44 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:45.166821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-91cf666a-efb4-4b5b-96e0-d6e344863d69 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:45.168935 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-91cf666a-efb4-4b5b-96e0-d6e344863d69 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:45.187731 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-91cf666a-efb4-4b5b-96e0-d6e344863d69 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:45.188607 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-91cf666a-efb4-4b5b-96e0-d6e344863d69 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:45.189797 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-91cf666a-efb4-4b5b-96e0-d6e344863d69 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:45.190814 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-91cf666a-efb4-4b5b-96e0-d6e344863d69 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:45.194615 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=100 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:45.353639 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-12cf637a-2ba8-4d4e-8d7d-fdf392f0f13f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:45.362275 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-12cf637a-2ba8-4d4e-8d7d-fdf392f0f13f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.291081 Jun 16 21:15:45.363455 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 199/377] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:45 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:45.371262 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-115af2e1-709a-4074-a5be-ca87fed6bce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:45.371883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-115af2e1-709a-4074-a5be-ca87fed6bce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:45.378448 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-115af2e1-709a-4074-a5be-ca87fed6bce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:45.378896 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-115af2e1-709a-4074-a5be-ca87fed6bce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:45.379854 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-115af2e1-709a-4074-a5be-ca87fed6bce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:45.380332 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-115af2e1-709a-4074-a5be-ca87fed6bce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:45.454611 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-91cf666a-efb4-4b5b-96e0-d6e344863d69 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:45.464078 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-91cf666a-efb4-4b5b-96e0-d6e344863d69 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.302428 Jun 16 21:15:45.466277 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 179/378] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:45 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:45.610845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-115af2e1-709a-4074-a5be-ca87fed6bce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:45.620590 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-115af2e1-709a-4074-a5be-ca87fed6bce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:45.622398 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-115af2e1-709a-4074-a5be-ca87fed6bce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:45.633351 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-115af2e1-709a-4074-a5be-ca87fed6bce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1737 microversion: 2.20 time: 0.265808 Jun 16 21:15:45.644100 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 200/379] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:45 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1737 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:46.052403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-610c5b0e-281e-4274-beaa-cbe86ba19dce tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:46.053663 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-610c5b0e-281e-4274-beaa-cbe86ba19dce tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:46.061105 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-610c5b0e-281e-4274-beaa-cbe86ba19dce tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:46.061530 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-610c5b0e-281e-4274-beaa-cbe86ba19dce tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:46.062298 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-610c5b0e-281e-4274-beaa-cbe86ba19dce tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:46.062728 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-610c5b0e-281e-4274-beaa-cbe86ba19dce tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:46.167365 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-6e90ccc3-5797-4635-b43e-f604bb25482f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:46.167978 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-6e90ccc3-5797-4635-b43e-f604bb25482f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:46.174370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6e90ccc3-5797-4635-b43e-f604bb25482f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:46.174814 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6e90ccc3-5797-4635-b43e-f604bb25482f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:46.175582 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6e90ccc3-5797-4635-b43e-f604bb25482f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:46.176014 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6e90ccc3-5797-4635-b43e-f604bb25482f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:46.212106 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-610c5b0e-281e-4274-beaa-cbe86ba19dce tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:46.219685 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-610c5b0e-281e-4274-beaa-cbe86ba19dce tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.171381 Jun 16 21:15:46.220362 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 180/380] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:46 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:46.381955 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-373c27a0-3df6-4420-9c65-f9a7be3faf4d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:46.382542 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-373c27a0-3df6-4420-9c65-f9a7be3faf4d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:46.397977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-373c27a0-3df6-4420-9c65-f9a7be3faf4d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:46.398370 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-373c27a0-3df6-4420-9c65-f9a7be3faf4d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:46.399214 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-373c27a0-3df6-4420-9c65-f9a7be3faf4d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:46.399616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-373c27a0-3df6-4420-9c65-f9a7be3faf4d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:46.548908 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6e90ccc3-5797-4635-b43e-f604bb25482f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:46.557199 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-6e90ccc3-5797-4635-b43e-f604bb25482f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.393995 Jun 16 21:15:46.557980 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 201/381] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:46 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:46.562405 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-df8442fc-72ab-4ef5-b91b-fa13a1d5975e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:46.563025 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-df8442fc-72ab-4ef5-b91b-fa13a1d5975e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:46.574365 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-df8442fc-72ab-4ef5-b91b-fa13a1d5975e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:46.575197 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-df8442fc-72ab-4ef5-b91b-fa13a1d5975e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:46.576148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-df8442fc-72ab-4ef5-b91b-fa13a1d5975e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:46.576585 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-df8442fc-72ab-4ef5-b91b-fa13a1d5975e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:46.585503 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-373c27a0-3df6-4420-9c65-f9a7be3faf4d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:46.594679 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-373c27a0-3df6-4420-9c65-f9a7be3faf4d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.216538 Jun 16 21:15:46.607690 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 181/382] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:46 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:46.653273 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c57a2529-37e6-415c-83bd-2ab905c1a242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:46.653806 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c57a2529-37e6-415c-83bd-2ab905c1a242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:46.660786 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c57a2529-37e6-415c-83bd-2ab905c1a242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:46.661221 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c57a2529-37e6-415c-83bd-2ab905c1a242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:46.661991 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c57a2529-37e6-415c-83bd-2ab905c1a242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:46.662486 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c57a2529-37e6-415c-83bd-2ab905c1a242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:46.742580 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-df8442fc-72ab-4ef5-b91b-fa13a1d5975e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:46.750829 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-df8442fc-72ab-4ef5-b91b-fa13a1d5975e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.191956 Jun 16 21:15:46.751690 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 202/383] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:46 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:46.836047 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c57a2529-37e6-415c-83bd-2ab905c1a242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:46.844327 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c57a2529-37e6-415c-83bd-2ab905c1a242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:46.845828 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c57a2529-37e6-415c-83bd-2ab905c1a242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:46.847001 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c57a2529-37e6-415c-83bd-2ab905c1a242 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1737 microversion: 2.20 time: 0.200047 Jun 16 21:15:46.847563 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 182/384] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:46 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:15:47.236217 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1b5b7ca2-8486-4446-82d6-63ce55ebdcb9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:47.236977 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1b5b7ca2-8486-4446-82d6-63ce55ebdcb9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:47.245007 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1b5b7ca2-8486-4446-82d6-63ce55ebdcb9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:47.245449 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1b5b7ca2-8486-4446-82d6-63ce55ebdcb9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:47.246227 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1b5b7ca2-8486-4446-82d6-63ce55ebdcb9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:47.246658 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1b5b7ca2-8486-4446-82d6-63ce55ebdcb9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:47.391099 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1b5b7ca2-8486-4446-82d6-63ce55ebdcb9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:47.398960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1b5b7ca2-8486-4446-82d6-63ce55ebdcb9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.166872 Jun 16 21:15:47.399669 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 203/385] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:47 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:47.574331 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b8ff4d1f-ab67-4af4-8ea6-f21aa6c7f05d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:47.575105 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b8ff4d1f-ab67-4af4-8ea6-f21aa6c7f05d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:47.581768 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b8ff4d1f-ab67-4af4-8ea6-f21aa6c7f05d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:47.582213 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b8ff4d1f-ab67-4af4-8ea6-f21aa6c7f05d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:47.582980 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b8ff4d1f-ab67-4af4-8ea6-f21aa6c7f05d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:47.583405 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b8ff4d1f-ab67-4af4-8ea6-f21aa6c7f05d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:47.617089 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-01594e56-2187-4db5-8034-83ed3152d76b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:47.617704 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-01594e56-2187-4db5-8034-83ed3152d76b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:47.623998 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-01594e56-2187-4db5-8034-83ed3152d76b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:47.624475 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-01594e56-2187-4db5-8034-83ed3152d76b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:47.625252 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-01594e56-2187-4db5-8034-83ed3152d76b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:47.625685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-01594e56-2187-4db5-8034-83ed3152d76b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:47.630872 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:47.757918 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b8ff4d1f-ab67-4af4-8ea6-f21aa6c7f05d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:47.766122 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b8ff4d1f-ab67-4af4-8ea6-f21aa6c7f05d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.195536 Jun 16 21:15:47.776946 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 183/386] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:47 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:47.776946 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4011d04e-b995-42f6-adca-fc0491be0694 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:47.776946 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4011d04e-b995-42f6-adca-fc0491be0694 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:47.793587 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-01594e56-2187-4db5-8034-83ed3152d76b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:47.794395 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4011d04e-b995-42f6-adca-fc0491be0694 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:47.794847 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4011d04e-b995-42f6-adca-fc0491be0694 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:47.795620 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4011d04e-b995-42f6-adca-fc0491be0694 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:47.796058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4011d04e-b995-42f6-adca-fc0491be0694 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:47.801536 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-01594e56-2187-4db5-8034-83ed3152d76b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.188624 Jun 16 21:15:47.802101 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 204/387] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:47 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:47.870363 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4400e9a5-b0a7-4741-a29f-4a962714feb7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:47.872874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4400e9a5-b0a7-4741-a29f-4a962714feb7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:47.882296 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4400e9a5-b0a7-4741-a29f-4a962714feb7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:47.883220 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4400e9a5-b0a7-4741-a29f-4a962714feb7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:47.885316 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4400e9a5-b0a7-4741-a29f-4a962714feb7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:47.885969 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4400e9a5-b0a7-4741-a29f-4a962714feb7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:47.966494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4011d04e-b995-42f6-adca-fc0491be0694 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:47.975808 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4011d04e-b995-42f6-adca-fc0491be0694 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.207410 Jun 16 21:15:47.976418 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 184/388] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:47 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:48.031956 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4400e9a5-b0a7-4741-a29f-4a962714feb7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:48.040684 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4400e9a5-b0a7-4741-a29f-4a962714feb7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:48.042215 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4400e9a5-b0a7-4741-a29f-4a962714feb7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:48.043376 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4400e9a5-b0a7-4741-a29f-4a962714feb7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1737 microversion: 2.20 time: 0.181668 Jun 16 21:15:48.044823 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 205/389] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:47 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:15:48.415832 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2672ebc9-4e07-494a-acfe-568c667ff761 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:48.416646 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2672ebc9-4e07-494a-acfe-568c667ff761 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:48.423618 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2672ebc9-4e07-494a-acfe-568c667ff761 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:48.424098 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2672ebc9-4e07-494a-acfe-568c667ff761 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:48.424963 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2672ebc9-4e07-494a-acfe-568c667ff761 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:48.425450 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2672ebc9-4e07-494a-acfe-568c667ff761 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:48.559209 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2672ebc9-4e07-494a-acfe-568c667ff761 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:48.566772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2672ebc9-4e07-494a-acfe-568c667ff761 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.154795 Jun 16 21:15:48.567631 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 185/390] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:48 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:48.783291 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c3b1767d-7465-4afe-b94e-59cad71b68b3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:48.783909 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c3b1767d-7465-4afe-b94e-59cad71b68b3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:48.795961 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c3b1767d-7465-4afe-b94e-59cad71b68b3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:48.796701 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c3b1767d-7465-4afe-b94e-59cad71b68b3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:48.797351 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c3b1767d-7465-4afe-b94e-59cad71b68b3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:48.797858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c3b1767d-7465-4afe-b94e-59cad71b68b3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:48.819655 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-10286fa2-bc09-447f-9610-d25531f87b53 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:48.820750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-10286fa2-bc09-447f-9610-d25531f87b53 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:48.826895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-10286fa2-bc09-447f-9610-d25531f87b53 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:48.827339 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-10286fa2-bc09-447f-9610-d25531f87b53 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:48.828125 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-10286fa2-bc09-447f-9610-d25531f87b53 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:48.828581 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-10286fa2-bc09-447f-9610-d25531f87b53 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:48.962706 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c3b1767d-7465-4afe-b94e-59cad71b68b3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:48.970662 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c3b1767d-7465-4afe-b94e-59cad71b68b3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.191272 Jun 16 21:15:48.971446 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 206/391] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:48 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:48.974340 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-10286fa2-bc09-447f-9610-d25531f87b53 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:48.983868 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-10286fa2-bc09-447f-9610-d25531f87b53 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.168431 Jun 16 21:15:48.984728 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 186/392] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:48 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:48.995533 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-32bef528-2eb6-4a3c-b384-cfcaa74d1aab tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:48.996340 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-32bef528-2eb6-4a3c-b384-cfcaa74d1aab tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:49.002643 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-32bef528-2eb6-4a3c-b384-cfcaa74d1aab tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:49.003209 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-32bef528-2eb6-4a3c-b384-cfcaa74d1aab tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:49.004083 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-32bef528-2eb6-4a3c-b384-cfcaa74d1aab tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:49.004652 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-32bef528-2eb6-4a3c-b384-cfcaa74d1aab tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:49.061963 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-434358ea-3e71-4c51-912b-5e582b79adac tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:49.062724 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-434358ea-3e71-4c51-912b-5e582b79adac tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:49.068718 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-434358ea-3e71-4c51-912b-5e582b79adac tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:49.069208 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-434358ea-3e71-4c51-912b-5e582b79adac tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:49.069937 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-434358ea-3e71-4c51-912b-5e582b79adac tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:49.070368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-434358ea-3e71-4c51-912b-5e582b79adac tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:49.148040 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-32bef528-2eb6-4a3c-b384-cfcaa74d1aab tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:49.156479 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-32bef528-2eb6-4a3c-b384-cfcaa74d1aab tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.167423 Jun 16 21:15:49.157131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 207/393] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:48 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:49.210901 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-434358ea-3e71-4c51-912b-5e582b79adac tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:49.218754 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-434358ea-3e71-4c51-912b-5e582b79adac tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:49.220282 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-434358ea-3e71-4c51-912b-5e582b79adac tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:49.221435 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-434358ea-3e71-4c51-912b-5e582b79adac tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1737 microversion: 2.20 time: 0.163332 Jun 16 21:15:49.221988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 187/394] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:49 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:15:49.583354 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-082021ed-5ac5-40a0-842d-6905a8f3cbcc tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:49.583990 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-082021ed-5ac5-40a0-842d-6905a8f3cbcc tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:49.591135 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-082021ed-5ac5-40a0-842d-6905a8f3cbcc tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:49.591581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-082021ed-5ac5-40a0-842d-6905a8f3cbcc tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:49.592370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-082021ed-5ac5-40a0-842d-6905a8f3cbcc tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:49.592803 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-082021ed-5ac5-40a0-842d-6905a8f3cbcc tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:49.722664 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-082021ed-5ac5-40a0-842d-6905a8f3cbcc tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:49.731148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-082021ed-5ac5-40a0-842d-6905a8f3cbcc tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.151603 Jun 16 21:15:49.731717 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 208/395] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:49 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:49.989344 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-610266a9-50cb-43a1-b5e1-71ce11ba8cdf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:49.989956 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-610266a9-50cb-43a1-b5e1-71ce11ba8cdf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:49.997101 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-610266a9-50cb-43a1-b5e1-71ce11ba8cdf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:49.997590 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-610266a9-50cb-43a1-b5e1-71ce11ba8cdf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:49.998493 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-610266a9-50cb-43a1-b5e1-71ce11ba8cdf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:49.998933 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-610266a9-50cb-43a1-b5e1-71ce11ba8cdf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:50.006276 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-fe2ab770-d0fc-45e4-abd7-48f1b69a4688 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:50.012086 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-fe2ab770-d0fc-45e4-abd7-48f1b69a4688 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:50.035303 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fe2ab770-d0fc-45e4-abd7-48f1b69a4688 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:50.035741 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fe2ab770-d0fc-45e4-abd7-48f1b69a4688 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:50.036584 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fe2ab770-d0fc-45e4-abd7-48f1b69a4688 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:50.037359 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fe2ab770-d0fc-45e4-abd7-48f1b69a4688 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:50.170660 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-610266a9-50cb-43a1-b5e1-71ce11ba8cdf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:50.179507 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-610266a9-50cb-43a1-b5e1-71ce11ba8cdf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.193931 Jun 16 21:15:50.180112 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 188/396] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:49 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:50.189337 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9c7cf172-3aad-41be-8093-768a611d542e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:50.189337 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-9c7cf172-3aad-41be-8093-768a611d542e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:50.190661 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-fe2ab770-d0fc-45e4-abd7-48f1b69a4688 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:50.190948 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9c7cf172-3aad-41be-8093-768a611d542e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:50.191391 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9c7cf172-3aad-41be-8093-768a611d542e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:50.192155 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9c7cf172-3aad-41be-8093-768a611d542e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:50.192614 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9c7cf172-3aad-41be-8093-768a611d542e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:50.198332 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-fe2ab770-d0fc-45e4-abd7-48f1b69a4688 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.199460 Jun 16 21:15:50.199199 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 209/397] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:49 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:50.240606 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f0575f1f-d272-401f-8bac-1e72fbcd97ee tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:50.241253 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f0575f1f-d272-401f-8bac-1e72fbcd97ee tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:50.249005 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f0575f1f-d272-401f-8bac-1e72fbcd97ee tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:50.249444 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f0575f1f-d272-401f-8bac-1e72fbcd97ee tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:50.250217 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f0575f1f-d272-401f-8bac-1e72fbcd97ee tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:50.250689 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f0575f1f-d272-401f-8bac-1e72fbcd97ee tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:50.330840 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9c7cf172-3aad-41be-8093-768a611d542e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:50.340074 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-9c7cf172-3aad-41be-8093-768a611d542e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.158927 Jun 16 21:15:50.362081 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 189/398] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:50 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:50.416289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f0575f1f-d272-401f-8bac-1e72fbcd97ee tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:50.425130 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f0575f1f-d272-401f-8bac-1e72fbcd97ee tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:50.426622 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f0575f1f-d272-401f-8bac-1e72fbcd97ee tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:50.427784 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f0575f1f-d272-401f-8bac-1e72fbcd97ee tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1737 microversion: 2.20 time: 0.191718 Jun 16 21:15:50.428461 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 210/399] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:50 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:15:50.749069 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-18ec1526-bd06-4dd2-b175-b4b74c5b12f7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:50.749611 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-18ec1526-bd06-4dd2-b175-b4b74c5b12f7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:50.755567 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-18ec1526-bd06-4dd2-b175-b4b74c5b12f7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:50.756080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-18ec1526-bd06-4dd2-b175-b4b74c5b12f7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:50.757578 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-18ec1526-bd06-4dd2-b175-b4b74c5b12f7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:50.758011 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-18ec1526-bd06-4dd2-b175-b4b74c5b12f7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:50.884902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-18ec1526-bd06-4dd2-b175-b4b74c5b12f7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:50.892144 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-18ec1526-bd06-4dd2-b175-b4b74c5b12f7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.146967 Jun 16 21:15:50.892721 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 190/400] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:50 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:51.196092 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4f8a6034-a9dd-4010-b477-92290990aae8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:51.196745 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4f8a6034-a9dd-4010-b477-92290990aae8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:51.203156 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f8a6034-a9dd-4010-b477-92290990aae8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:51.203594 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f8a6034-a9dd-4010-b477-92290990aae8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:51.204378 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f8a6034-a9dd-4010-b477-92290990aae8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:51.204803 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f8a6034-a9dd-4010-b477-92290990aae8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:51.215868 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9656c5ed-ff92-4368-bf6c-b4a0209148a3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:51.216707 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-9656c5ed-ff92-4368-bf6c-b4a0209148a3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:51.225686 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9656c5ed-ff92-4368-bf6c-b4a0209148a3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:51.226461 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9656c5ed-ff92-4368-bf6c-b4a0209148a3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:51.227252 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9656c5ed-ff92-4368-bf6c-b4a0209148a3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:51.227684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9656c5ed-ff92-4368-bf6c-b4a0209148a3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:51.337749 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4f8a6034-a9dd-4010-b477-92290990aae8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:51.345669 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4f8a6034-a9dd-4010-b477-92290990aae8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.153356 Jun 16 21:15:51.352767 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 211/401] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:51 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:51.357566 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b1377af1-e31f-4848-8fe1-bf1405e26d11 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:51.358177 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b1377af1-e31f-4848-8fe1-bf1405e26d11 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:51.361381 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9656c5ed-ff92-4368-bf6c-b4a0209148a3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:51.364507 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b1377af1-e31f-4848-8fe1-bf1405e26d11 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:51.364950 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b1377af1-e31f-4848-8fe1-bf1405e26d11 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:51.366222 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b1377af1-e31f-4848-8fe1-bf1405e26d11 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:51.366978 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b1377af1-e31f-4848-8fe1-bf1405e26d11 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:51.370103 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-9656c5ed-ff92-4368-bf6c-b4a0209148a3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.158758 Jun 16 21:15:51.370937 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 191/402] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:51 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:51.446897 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-47adae8f-bdb6-4a9b-8e10-c15a20658886 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:51.447503 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-47adae8f-bdb6-4a9b-8e10-c15a20658886 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:51.454113 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-47adae8f-bdb6-4a9b-8e10-c15a20658886 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:51.454581 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-47adae8f-bdb6-4a9b-8e10-c15a20658886 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:51.455525 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-47adae8f-bdb6-4a9b-8e10-c15a20658886 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:51.456088 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-47adae8f-bdb6-4a9b-8e10-c15a20658886 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:51.521842 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b1377af1-e31f-4848-8fe1-bf1405e26d11 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:51.529269 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b1377af1-e31f-4848-8fe1-bf1405e26d11 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.175585 Jun 16 21:15:51.530023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 212/403] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:51 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:51.614364 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-47adae8f-bdb6-4a9b-8e10-c15a20658886 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:51.623282 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-47adae8f-bdb6-4a9b-8e10-c15a20658886 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:51.624892 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-47adae8f-bdb6-4a9b-8e10-c15a20658886 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:51.626033 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-47adae8f-bdb6-4a9b-8e10-c15a20658886 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1719 microversion: 2.20 time: 0.183893 Jun 16 21:15:51.626578 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 192/404] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:51 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1719 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:15:51.908833 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4b2017d5-a0fa-44f6-ba0c-285067b1f013 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:51.909363 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4b2017d5-a0fa-44f6-ba0c-285067b1f013 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:51.916144 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b2017d5-a0fa-44f6-ba0c-285067b1f013 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:51.916611 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b2017d5-a0fa-44f6-ba0c-285067b1f013 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:51.917377 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b2017d5-a0fa-44f6-ba0c-285067b1f013 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:51.917807 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b2017d5-a0fa-44f6-ba0c-285067b1f013 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:52.043710 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4b2017d5-a0fa-44f6-ba0c-285067b1f013 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:52.051074 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4b2017d5-a0fa-44f6-ba0c-285067b1f013 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.146155 Jun 16 21:15:52.051633 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 213/405] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:51 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:52.363281 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c67535e5-7bee-418b-9fe0-14b04f8e23bf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:52.363884 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c67535e5-7bee-418b-9fe0-14b04f8e23bf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:52.370790 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c67535e5-7bee-418b-9fe0-14b04f8e23bf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:52.371235 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c67535e5-7bee-418b-9fe0-14b04f8e23bf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:52.371978 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c67535e5-7bee-418b-9fe0-14b04f8e23bf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:52.372427 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c67535e5-7bee-418b-9fe0-14b04f8e23bf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:52.388484 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-95f0d38c-6765-4678-a015-cf0a9a50958d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:52.389128 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-95f0d38c-6765-4678-a015-cf0a9a50958d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:52.395470 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-95f0d38c-6765-4678-a015-cf0a9a50958d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:52.395915 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-95f0d38c-6765-4678-a015-cf0a9a50958d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:52.396761 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-95f0d38c-6765-4678-a015-cf0a9a50958d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:52.397294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-95f0d38c-6765-4678-a015-cf0a9a50958d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:52.507669 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c67535e5-7bee-418b-9fe0-14b04f8e23bf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:52.517327 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c67535e5-7bee-418b-9fe0-14b04f8e23bf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.158143 Jun 16 21:15:52.517910 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 193/406] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:52 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:52.529887 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-95f0d38c-6765-4678-a015-cf0a9a50958d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:52.538069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-95f0d38c-6765-4678-a015-cf0a9a50958d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.152799 Jun 16 21:15:52.538657 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 214/407] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:52 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:52.546276 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4777ef06-1a7a-4442-a7ba-a6721258a2b7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:52.546972 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4777ef06-1a7a-4442-a7ba-a6721258a2b7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:52.552896 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4777ef06-1a7a-4442-a7ba-a6721258a2b7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:52.554460 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4777ef06-1a7a-4442-a7ba-a6721258a2b7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:52.555219 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4777ef06-1a7a-4442-a7ba-a6721258a2b7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:52.555656 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4777ef06-1a7a-4442-a7ba-a6721258a2b7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:52.644953 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b5d64bba-172f-49bc-8efb-79370a93a069 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:52.645561 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b5d64bba-172f-49bc-8efb-79370a93a069 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:52.651681 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b5d64bba-172f-49bc-8efb-79370a93a069 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:52.652112 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b5d64bba-172f-49bc-8efb-79370a93a069 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:52.652916 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b5d64bba-172f-49bc-8efb-79370a93a069 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:52.653343 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b5d64bba-172f-49bc-8efb-79370a93a069 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:52.685649 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4777ef06-1a7a-4442-a7ba-a6721258a2b7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:52.693227 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4777ef06-1a7a-4442-a7ba-a6721258a2b7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.150679 Jun 16 21:15:52.693875 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 194/408] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:52 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:52.790018 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b5d64bba-172f-49bc-8efb-79370a93a069 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:52.798372 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b5d64bba-172f-49bc-8efb-79370a93a069 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:52.799960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b5d64bba-172f-49bc-8efb-79370a93a069 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:52.801289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b5d64bba-172f-49bc-8efb-79370a93a069 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1719 microversion: 2.20 time: 0.160063 Jun 16 21:15:52.801874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 215/409] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:52 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:15:53.068816 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a55de121-8b35-494b-b77a-d328595d8333 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:53.069340 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a55de121-8b35-494b-b77a-d328595d8333 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:53.075704 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a55de121-8b35-494b-b77a-d328595d8333 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:53.076147 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a55de121-8b35-494b-b77a-d328595d8333 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:53.076941 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a55de121-8b35-494b-b77a-d328595d8333 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:53.077370 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a55de121-8b35-494b-b77a-d328595d8333 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:53.211744 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a55de121-8b35-494b-b77a-d328595d8333 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:53.213944 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=100 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:53.220216 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a55de121-8b35-494b-b77a-d328595d8333 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1366 microversion: 2.1 time: 0.155267 Jun 16 21:15:53.220781 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 195/410] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:53 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:53.534802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0b7779e1-7de5-4d7a-a963-37dfc23d9063 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:53.535419 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0b7779e1-7de5-4d7a-a963-37dfc23d9063 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:53.542805 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0b7779e1-7de5-4d7a-a963-37dfc23d9063 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:53.543250 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0b7779e1-7de5-4d7a-a963-37dfc23d9063 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:53.544021 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0b7779e1-7de5-4d7a-a963-37dfc23d9063 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:53.544654 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0b7779e1-7de5-4d7a-a963-37dfc23d9063 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:53.555609 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5b2d8965-f4c9-48a0-b065-757a420d0399 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:53.556871 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5b2d8965-f4c9-48a0-b065-757a420d0399 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:53.575682 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5b2d8965-f4c9-48a0-b065-757a420d0399 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:53.576136 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5b2d8965-f4c9-48a0-b065-757a420d0399 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:53.576938 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5b2d8965-f4c9-48a0-b065-757a420d0399 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:53.577654 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5b2d8965-f4c9-48a0-b065-757a420d0399 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:53.718928 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0b7779e1-7de5-4d7a-a963-37dfc23d9063 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:53.727947 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5b2d8965-f4c9-48a0-b065-757a420d0399 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:53.728525 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0b7779e1-7de5-4d7a-a963-37dfc23d9063 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.197489 Jun 16 21:15:53.729350 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 216/411] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:53 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:53.735567 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5b2d8965-f4c9-48a0-b065-757a420d0399 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.184495 Jun 16 21:15:53.736127 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 196/412] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:53 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:53.743530 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-abccb561-b5c1-4f83-9754-72e2e43d11fd tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:53.744127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-abccb561-b5c1-4f83-9754-72e2e43d11fd tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:53.749965 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-abccb561-b5c1-4f83-9754-72e2e43d11fd tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:53.750403 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-abccb561-b5c1-4f83-9754-72e2e43d11fd tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:53.751148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-abccb561-b5c1-4f83-9754-72e2e43d11fd tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:53.751570 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-abccb561-b5c1-4f83-9754-72e2e43d11fd tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:53.820934 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-56767da7-b9b6-4468-ac74-26ceb790ef63 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:53.821540 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-56767da7-b9b6-4468-ac74-26ceb790ef63 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:53.827321 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-56767da7-b9b6-4468-ac74-26ceb790ef63 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:53.827761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-56767da7-b9b6-4468-ac74-26ceb790ef63 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:53.828545 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-56767da7-b9b6-4468-ac74-26ceb790ef63 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:53.828970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-56767da7-b9b6-4468-ac74-26ceb790ef63 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:53.880654 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-abccb561-b5c1-4f83-9754-72e2e43d11fd tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:53.888765 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-abccb561-b5c1-4f83-9754-72e2e43d11fd tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.149328 Jun 16 21:15:53.889324 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 217/413] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:53 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:53.956074 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-56767da7-b9b6-4468-ac74-26ceb790ef63 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:53.963910 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-56767da7-b9b6-4468-ac74-26ceb790ef63 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:53.965439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-56767da7-b9b6-4468-ac74-26ceb790ef63 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:53.966594 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-56767da7-b9b6-4468-ac74-26ceb790ef63 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1719 microversion: 2.20 time: 0.150236 Jun 16 21:15:53.967151 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 197/414] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:53 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:15:54.231365 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4d14bd14-cd1a-4e75-a05e-1bd0de4dfd11 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:54.231867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4d14bd14-cd1a-4e75-a05e-1bd0de4dfd11 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:54.237125 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0058bd4f-1742-4e1e-936b-771f31d99c25 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:54.238015 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0058bd4f-1742-4e1e-936b-771f31d99c25 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:54.238180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4d14bd14-cd1a-4e75-a05e-1bd0de4dfd11 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:54.238630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4d14bd14-cd1a-4e75-a05e-1bd0de4dfd11 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:54.239395 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4d14bd14-cd1a-4e75-a05e-1bd0de4dfd11 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:54.239831 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4d14bd14-cd1a-4e75-a05e-1bd0de4dfd11 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:54.244356 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0058bd4f-1742-4e1e-936b-771f31d99c25 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:54.244807 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0058bd4f-1742-4e1e-936b-771f31d99c25 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:54.245570 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0058bd4f-1742-4e1e-936b-771f31d99c25 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:54.246007 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0058bd4f-1742-4e1e-936b-771f31d99c25 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:54.265662 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4d14bd14-cd1a-4e75-a05e-1bd0de4dfd11 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Going to try to terminate instance {{(pid=117737) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:15:54.336658 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:54.343428 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4d14bd14-cd1a-4e75-a05e-1bd0de4dfd11 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 204 len: 0 microversion: 2.1 time: 0.115602 Jun 16 21:15:54.344011 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 218/415] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:15:54 2022] DELETE /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:15:54.352531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0d5d82fa-993a-480d-868e-d3c5cfe798ba tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:54.353232 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0d5d82fa-993a-480d-868e-d3c5cfe798ba tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:54.359080 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0d5d82fa-993a-480d-868e-d3c5cfe798ba tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:54.359523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0d5d82fa-993a-480d-868e-d3c5cfe798ba tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:54.360324 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0d5d82fa-993a-480d-868e-d3c5cfe798ba tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:54.360755 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0d5d82fa-993a-480d-868e-d3c5cfe798ba tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:54.365119 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:54.383921 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0058bd4f-1742-4e1e-936b-771f31d99c25 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:54.391628 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0058bd4f-1742-4e1e-936b-771f31d99c25 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1557 microversion: 2.1 time: 0.159104 Jun 16 21:15:54.392222 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 198/416] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:54 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:54.408078 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4938d0b8-a4ad-416d-a817-7a76d150a5f5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:54.408743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4938d0b8-a4ad-416d-a817-7a76d150a5f5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:54.415648 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4938d0b8-a4ad-416d-a817-7a76d150a5f5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:54.416078 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4938d0b8-a4ad-416d-a817-7a76d150a5f5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:54.416864 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4938d0b8-a4ad-416d-a817-7a76d150a5f5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:54.417293 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4938d0b8-a4ad-416d-a817-7a76d150a5f5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:54.494981 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4938d0b8-a4ad-416d-a817-7a76d150a5f5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090873 Jun 16 21:15:54.495686 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 199/417] 10.222.0.43 () {58 vars in 1274 bytes} [Thu Jun 16 21:15:54 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:15:54.500465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0d5d82fa-993a-480d-868e-d3c5cfe798ba tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:54.508189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0d5d82fa-993a-480d-868e-d3c5cfe798ba tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1514 microversion: 2.1 time: 0.159935 Jun 16 21:15:54.508784 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 219/418] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:54 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:54.747153 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-58f99bd4-ca6a-42ff-a9a3-a8c84a4fc93f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:54.748278 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-58f99bd4-ca6a-42ff-a9a3-a8c84a4fc93f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:54.752981 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-bc8b20a5-0937-4364-9a3a-4cfb4a30cc92 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:54.753938 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-bc8b20a5-0937-4364-9a3a-4cfb4a30cc92 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:54.754085 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-58f99bd4-ca6a-42ff-a9a3-a8c84a4fc93f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:54.754491 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-58f99bd4-ca6a-42ff-a9a3-a8c84a4fc93f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:54.755253 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-58f99bd4-ca6a-42ff-a9a3-a8c84a4fc93f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:54.755685 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-58f99bd4-ca6a-42ff-a9a3-a8c84a4fc93f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:54.760203 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bc8b20a5-0937-4364-9a3a-4cfb4a30cc92 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:54.760678 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bc8b20a5-0937-4364-9a3a-4cfb4a30cc92 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:54.761452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bc8b20a5-0937-4364-9a3a-4cfb4a30cc92 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:54.761883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bc8b20a5-0937-4364-9a3a-4cfb4a30cc92 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:54.888023 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-58f99bd4-ca6a-42ff-a9a3-a8c84a4fc93f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:54.895955 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-58f99bd4-ca6a-42ff-a9a3-a8c84a4fc93f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.153140 Jun 16 21:15:54.896664 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 200/419] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:54 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:54.910643 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-24fa930a-9587-4471-a046-fd64778e9f57 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:54.911255 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-24fa930a-9587-4471-a046-fd64778e9f57 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:54.917675 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-24fa930a-9587-4471-a046-fd64778e9f57 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:54.918134 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-24fa930a-9587-4471-a046-fd64778e9f57 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:54.918908 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-24fa930a-9587-4471-a046-fd64778e9f57 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:54.919343 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-24fa930a-9587-4471-a046-fd64778e9f57 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:55.014183 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bc8b20a5-0937-4364-9a3a-4cfb4a30cc92 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:55.024394 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-bc8b20a5-0937-4364-9a3a-4cfb4a30cc92 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1523 microversion: 2.1 time: 0.274741 Jun 16 21:15:55.033765 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 220/420] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:54 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:55.039101 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9f964b7e-64f7-42a5-ac09-31bede726a05 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:55.039715 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-9f964b7e-64f7-42a5-ac09-31bede726a05 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:55.046086 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9f964b7e-64f7-42a5-ac09-31bede726a05 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:55.046528 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9f964b7e-64f7-42a5-ac09-31bede726a05 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:55.047286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9f964b7e-64f7-42a5-ac09-31bede726a05 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:55.047897 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9f964b7e-64f7-42a5-ac09-31bede726a05 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:55.059086 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-24fa930a-9587-4471-a046-fd64778e9f57 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:55.067767 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-24fa930a-9587-4471-a046-fd64778e9f57 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.160977 Jun 16 21:15:55.069198 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 201/421] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:54 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:55.294974 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9f964b7e-64f7-42a5-ac09-31bede726a05 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:55.304446 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9f964b7e-64f7-42a5-ac09-31bede726a05 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:55.306073 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9f964b7e-64f7-42a5-ac09-31bede726a05 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:55.307651 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9f964b7e-64f7-42a5-ac09-31bede726a05 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1719 microversion: 2.20 time: 0.272748 Jun 16 21:15:55.308423 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 221/422] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:55 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1719 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:55.525435 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7e21dd46-12ec-4276-b736-1ccae0595bd8 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:55.525963 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7e21dd46-12ec-4276-b736-1ccae0595bd8 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:55.531895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7e21dd46-12ec-4276-b736-1ccae0595bd8 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:55.532379 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7e21dd46-12ec-4276-b736-1ccae0595bd8 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:55.533138 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7e21dd46-12ec-4276-b736-1ccae0595bd8 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:55.533573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7e21dd46-12ec-4276-b736-1ccae0595bd8 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:55.595750 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-19c62151-2745-4624-a697-386386f21d5c req-ba719602-eee8-4764-8b0d-aa2509d51f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fe2c1e9-e3e7-437a-b627-53fa261bfe2f", "tag": "6d083cc3-57c5-45ee-8b91-13084586fee3"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:15:55.611820 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-19c62151-2745-4624-a697-386386f21d5c req-ba719602-eee8-4764-8b0d-aa2509d51f5f service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:55.612468 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-19c62151-2745-4624-a697-386386f21d5c req-ba719602-eee8-4764-8b0d-aa2509d51f5f service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:55.624607 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-19c62151-2745-4624-a697-386386f21d5c req-ba719602-eee8-4764-8b0d-aa2509d51f5f service nova] Creating event network-changed:6d083cc3-57c5-45ee-8b91-13084586fee3 for instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f on hv-cinder-81914 Jun 16 21:15:55.632537 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-19c62151-2745-4624-a697-386386f21d5c req-ba719602-eee8-4764-8b0d-aa2509d51f5f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040640 Jun 16 21:15:55.633449 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 222/423] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:15:55.693275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-7e21dd46-12ec-4276-b736-1ccae0595bd8 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:55.701188 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7e21dd46-12ec-4276-b736-1ccae0595bd8 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1514 microversion: 2.1 time: 0.179869 Jun 16 21:15:55.701761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 202/424] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:55 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:55.914256 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0eee68b6-90c0-4e28-ba8c-b445f2c2a6e3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:55.914958 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0eee68b6-90c0-4e28-ba8c-b445f2c2a6e3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:55.921326 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0eee68b6-90c0-4e28-ba8c-b445f2c2a6e3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:55.921769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0eee68b6-90c0-4e28-ba8c-b445f2c2a6e3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:55.922517 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0eee68b6-90c0-4e28-ba8c-b445f2c2a6e3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:55.922940 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0eee68b6-90c0-4e28-ba8c-b445f2c2a6e3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:56.041411 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-417a8aad-1b12-4448-8f7c-6677d65c6297 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:56.042003 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-417a8aad-1b12-4448-8f7c-6677d65c6297 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:56.048512 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-417a8aad-1b12-4448-8f7c-6677d65c6297 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:56.048953 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-417a8aad-1b12-4448-8f7c-6677d65c6297 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:56.049714 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-417a8aad-1b12-4448-8f7c-6677d65c6297 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:56.050275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-417a8aad-1b12-4448-8f7c-6677d65c6297 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:56.056340 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0eee68b6-90c0-4e28-ba8c-b445f2c2a6e3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:56.064847 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0eee68b6-90c0-4e28-ba8c-b445f2c2a6e3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.155306 Jun 16 21:15:56.067556 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 223/425] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:55 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:56.084981 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8e29bd2d-50b8-4c4e-9be5-df04a013272f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:56.085826 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8e29bd2d-50b8-4c4e-9be5-df04a013272f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:56.091914 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8e29bd2d-50b8-4c4e-9be5-df04a013272f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:56.092470 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8e29bd2d-50b8-4c4e-9be5-df04a013272f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:56.093332 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8e29bd2d-50b8-4c4e-9be5-df04a013272f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:56.093838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8e29bd2d-50b8-4c4e-9be5-df04a013272f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:56.194112 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-417a8aad-1b12-4448-8f7c-6677d65c6297 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:56.202509 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-417a8aad-1b12-4448-8f7c-6677d65c6297 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1503 microversion: 2.1 time: 0.165657 Jun 16 21:15:56.203083 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 203/426] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:56 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:56.219354 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-82be2cdc-9386-4bed-9a13-e702455026f2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:56.220310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-82be2cdc-9386-4bed-9a13-e702455026f2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:56.226707 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-82be2cdc-9386-4bed-9a13-e702455026f2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:56.227139 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-82be2cdc-9386-4bed-9a13-e702455026f2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:56.227896 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-82be2cdc-9386-4bed-9a13-e702455026f2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:56.228376 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-82be2cdc-9386-4bed-9a13-e702455026f2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:56.232980 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8e29bd2d-50b8-4c4e-9be5-df04a013272f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:56.242053 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8e29bd2d-50b8-4c4e-9be5-df04a013272f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.160795 Jun 16 21:15:56.242888 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 224/427] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:56 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:56.331762 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-6fe70079-34fe-457e-93dd-a3ac6a95ecb0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:56.332534 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-6fe70079-34fe-457e-93dd-a3ac6a95ecb0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:56.339484 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6fe70079-34fe-457e-93dd-a3ac6a95ecb0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:56.339484 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6fe70079-34fe-457e-93dd-a3ac6a95ecb0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:56.339913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6fe70079-34fe-457e-93dd-a3ac6a95ecb0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:56.340325 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6fe70079-34fe-457e-93dd-a3ac6a95ecb0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:56.370326 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-82be2cdc-9386-4bed-9a13-e702455026f2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:56.379039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-82be2cdc-9386-4bed-9a13-e702455026f2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1516 microversion: 2.1 time: 0.163934 Jun 16 21:15:56.380218 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 204/428] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:56 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:56.419873 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-e3446149-190a-4ce6-9609-dc1ca057df6e req-b23c9cb4-cb4e-4482-b881-aded762428f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2281b8c3-ec1f-478b-bd50-128d5cf67a04", "name": "network-vif-unplugged", "status": "completed", "tag": "6473309c-d2e4-42b4-94b1-6b373a5e59f2"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:15:56.433263 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-e3446149-190a-4ce6-9609-dc1ca057df6e req-b23c9cb4-cb4e-4482-b881-aded762428f1 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:56.433734 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-e3446149-190a-4ce6-9609-dc1ca057df6e req-b23c9cb4-cb4e-4482-b881-aded762428f1 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:56.461717 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-e3446149-190a-4ce6-9609-dc1ca057df6e req-b23c9cb4-cb4e-4482-b881-aded762428f1 service nova] Creating event network-vif-unplugged:6473309c-d2e4-42b4-94b1-6b373a5e59f2 for instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 on hv-cinder-81914 Jun 16 21:15:56.473358 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-e3446149-190a-4ce6-9609-dc1ca057df6e req-b23c9cb4-cb4e-4482-b881-aded762428f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057035 Jun 16 21:15:56.475614 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 205/429] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:15:56.538961 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6fe70079-34fe-457e-93dd-a3ac6a95ecb0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:56.549036 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6fe70079-34fe-457e-93dd-a3ac6a95ecb0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:56.551452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6fe70079-34fe-457e-93dd-a3ac6a95ecb0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:56.552796 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-6fe70079-34fe-457e-93dd-a3ac6a95ecb0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1719 microversion: 2.20 time: 0.224992 Jun 16 21:15:56.553584 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 225/430] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:56 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1719 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:15:56.721126 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-61b564ab-3fa2-4988-a86b-9d0fcc152566 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:56.721896 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-61b564ab-3fa2-4988-a86b-9d0fcc152566 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:56.730778 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-61b564ab-3fa2-4988-a86b-9d0fcc152566 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:56.731357 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-61b564ab-3fa2-4988-a86b-9d0fcc152566 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:56.732489 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-61b564ab-3fa2-4988-a86b-9d0fcc152566 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:56.733064 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-61b564ab-3fa2-4988-a86b-9d0fcc152566 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:56.875258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-61b564ab-3fa2-4988-a86b-9d0fcc152566 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:56.883565 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-61b564ab-3fa2-4988-a86b-9d0fcc152566 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1514 microversion: 2.1 time: 0.168684 Jun 16 21:15:56.884130 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 206/431] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:56 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:57.082151 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b5be0c44-fd06-43d3-a3d0-6c71670a434b tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:57.082785 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b5be0c44-fd06-43d3-a3d0-6c71670a434b tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:57.089392 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b5be0c44-fd06-43d3-a3d0-6c71670a434b tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:57.089829 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b5be0c44-fd06-43d3-a3d0-6c71670a434b tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:57.090575 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b5be0c44-fd06-43d3-a3d0-6c71670a434b tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:57.091001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b5be0c44-fd06-43d3-a3d0-6c71670a434b tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:57.234210 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b5be0c44-fd06-43d3-a3d0-6c71670a434b tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:57.244055 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b5be0c44-fd06-43d3-a3d0-6c71670a434b tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.165547 Jun 16 21:15:57.244676 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 226/432] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:57 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:57.259875 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d85a5ce2-2b2e-4d98-8c1a-57e1fbe38f77 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:57.260510 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d85a5ce2-2b2e-4d98-8c1a-57e1fbe38f77 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:57.266902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d85a5ce2-2b2e-4d98-8c1a-57e1fbe38f77 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:57.267338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d85a5ce2-2b2e-4d98-8c1a-57e1fbe38f77 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:57.268086 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d85a5ce2-2b2e-4d98-8c1a-57e1fbe38f77 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:57.268547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d85a5ce2-2b2e-4d98-8c1a-57e1fbe38f77 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:57.485781 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d85a5ce2-2b2e-4d98-8c1a-57e1fbe38f77 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:57.493802 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d85a5ce2-2b2e-4d98-8c1a-57e1fbe38f77 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.238675 Jun 16 21:15:57.494363 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 207/433] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:57 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:57.571173 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-671c4396-5b5a-4f3f-9468-bac0321f104d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:57.571782 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-671c4396-5b5a-4f3f-9468-bac0321f104d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:57.577700 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-671c4396-5b5a-4f3f-9468-bac0321f104d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:57.578149 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-671c4396-5b5a-4f3f-9468-bac0321f104d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:57.578905 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-671c4396-5b5a-4f3f-9468-bac0321f104d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:57.579338 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-671c4396-5b5a-4f3f-9468-bac0321f104d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:57.707631 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-671c4396-5b5a-4f3f-9468-bac0321f104d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:57.716210 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-671c4396-5b5a-4f3f-9468-bac0321f104d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:57.717697 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-671c4396-5b5a-4f3f-9468-bac0321f104d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:57.718842 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-671c4396-5b5a-4f3f-9468-bac0321f104d tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1719 microversion: 2.20 time: 0.152036 Jun 16 21:15:57.719395 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 227/434] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:57 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:57.803387 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-cc1312b0-c8a2-4548-b257-894eda8bdfbe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:15:57.804487 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-cc1312b0-c8a2-4548-b257-894eda8bdfbe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:57.810364 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cc1312b0-c8a2-4548-b257-894eda8bdfbe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:57.810804 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cc1312b0-c8a2-4548-b257-894eda8bdfbe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:57.811554 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cc1312b0-c8a2-4548-b257-894eda8bdfbe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:57.811982 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cc1312b0-c8a2-4548-b257-894eda8bdfbe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:57.835240 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.objects.instance [None req-cc1312b0-c8a2-4548-b257-894eda8bdfbe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lazy-loading 'flavor' on Instance uuid 633275c9-cc8b-4860-b701-2085f7323773 {{(pid=117738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:15:57.900803 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7861f653-8ec2-4c26-aa8e-29df69f053f8 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:57.901438 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7861f653-8ec2-4c26-aa8e-29df69f053f8 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:57.905447 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-cc1312b0-c8a2-4548-b257-894eda8bdfbe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "POST /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773/action" status: 200 len: 32 microversion: 2.1 time: 0.106030 Jun 16 21:15:57.906059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 208/435] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 16 21:15:57 2022] POST /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773/action => generated 32 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 21:15:57.911645 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7861f653-8ec2-4c26-aa8e-29df69f053f8 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:57.912027 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7861f653-8ec2-4c26-aa8e-29df69f053f8 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:57.912971 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7861f653-8ec2-4c26-aa8e-29df69f053f8 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:57.913477 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7861f653-8ec2-4c26-aa8e-29df69f053f8 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:57.918794 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8abee735-6c77-443e-888c-e0e0318446a1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:57.919854 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8abee735-6c77-443e-888c-e0e0318446a1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:57.926520 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8abee735-6c77-443e-888c-e0e0318446a1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:57.926961 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8abee735-6c77-443e-888c-e0e0318446a1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:57.927742 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8abee735-6c77-443e-888c-e0e0318446a1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:57.928220 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8abee735-6c77-443e-888c-e0e0318446a1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:58.056482 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7861f653-8ec2-4c26-aa8e-29df69f053f8 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:58.065030 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7861f653-8ec2-4c26-aa8e-29df69f053f8 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1514 microversion: 2.1 time: 0.168705 Jun 16 21:15:58.065627 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 228/436] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:57 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:58.171859 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8abee735-6c77-443e-888c-e0e0318446a1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:58.180235 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8abee735-6c77-443e-888c-e0e0318446a1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.266349 Jun 16 21:15:58.180939 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 209/437] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:57 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:15:58.263121 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-bacd7b1d-874a-41f0-8883-d20abf027ec8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:58.263762 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-bacd7b1d-874a-41f0-8883-d20abf027ec8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:58.270239 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bacd7b1d-874a-41f0-8883-d20abf027ec8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:58.270686 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bacd7b1d-874a-41f0-8883-d20abf027ec8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:58.271444 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bacd7b1d-874a-41f0-8883-d20abf027ec8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:58.271917 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bacd7b1d-874a-41f0-8883-d20abf027ec8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:58.408687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bacd7b1d-874a-41f0-8883-d20abf027ec8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:58.417231 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-bacd7b1d-874a-41f0-8883-d20abf027ec8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.157923 Jun 16 21:15:58.417792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 229/438] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:58 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:58.510986 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4801a794-96da-4f51-b5b0-a1fdeedaf577 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:58.511519 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4801a794-96da-4f51-b5b0-a1fdeedaf577 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:58.517847 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4801a794-96da-4f51-b5b0-a1fdeedaf577 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:58.518280 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4801a794-96da-4f51-b5b0-a1fdeedaf577 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:58.519023 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4801a794-96da-4f51-b5b0-a1fdeedaf577 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:58.519475 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4801a794-96da-4f51-b5b0-a1fdeedaf577 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:58.652590 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4801a794-96da-4f51-b5b0-a1fdeedaf577 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:58.660007 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4801a794-96da-4f51-b5b0-a1fdeedaf577 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.153003 Jun 16 21:15:58.660591 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 210/439] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:58 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:58.737412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-59d8af80-cd5e-4948-8fe6-58f7f3109ac7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:58.738277 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-59d8af80-cd5e-4948-8fe6-58f7f3109ac7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:58.744155 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-59d8af80-cd5e-4948-8fe6-58f7f3109ac7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:58.744616 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-59d8af80-cd5e-4948-8fe6-58f7f3109ac7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:58.745360 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-59d8af80-cd5e-4948-8fe6-58f7f3109ac7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:58.745785 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-59d8af80-cd5e-4948-8fe6-58f7f3109ac7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:58.876524 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-59d8af80-cd5e-4948-8fe6-58f7f3109ac7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:58.884968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-59d8af80-cd5e-4948-8fe6-58f7f3109ac7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:58.886471 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-59d8af80-cd5e-4948-8fe6-58f7f3109ac7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:58.887623 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-59d8af80-cd5e-4948-8fe6-58f7f3109ac7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1719 microversion: 2.20 time: 0.154034 Jun 16 21:15:58.888196 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 230/440] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:58 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:15:59.082815 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4882f2ee-e71c-4fa6-abe4-944b8047220c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:59.083351 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4882f2ee-e71c-4fa6-abe4-944b8047220c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:59.089622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4882f2ee-e71c-4fa6-abe4-944b8047220c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:59.090071 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4882f2ee-e71c-4fa6-abe4-944b8047220c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:59.090823 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4882f2ee-e71c-4fa6-abe4-944b8047220c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:59.091252 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4882f2ee-e71c-4fa6-abe4-944b8047220c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:59.106148 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:59.198277 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-edd728c5-0138-4fd2-86b7-1bf13c80ee62 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:59.198891 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-edd728c5-0138-4fd2-86b7-1bf13c80ee62 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:59.205013 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-edd728c5-0138-4fd2-86b7-1bf13c80ee62 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:59.205464 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-edd728c5-0138-4fd2-86b7-1bf13c80ee62 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:59.206243 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-edd728c5-0138-4fd2-86b7-1bf13c80ee62 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:59.206681 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-edd728c5-0138-4fd2-86b7-1bf13c80ee62 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:59.393879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4882f2ee-e71c-4fa6-abe4-944b8047220c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:59.403532 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4882f2ee-e71c-4fa6-abe4-944b8047220c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1514 microversion: 2.1 time: 0.324474 Jun 16 21:15:59.415959 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 211/441] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:59 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1514 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:59.435099 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-cc3cac81-8530-4377-b87f-2839649e543d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:59.435851 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-cc3cac81-8530-4377-b87f-2839649e543d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:59.442094 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cc3cac81-8530-4377-b87f-2839649e543d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:59.442620 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cc3cac81-8530-4377-b87f-2839649e543d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:59.444006 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cc3cac81-8530-4377-b87f-2839649e543d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:59.444704 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cc3cac81-8530-4377-b87f-2839649e543d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:59.537410 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-edd728c5-0138-4fd2-86b7-1bf13c80ee62 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:59.545975 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-edd728c5-0138-4fd2-86b7-1bf13c80ee62 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.351970 Jun 16 21:15:59.546665 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 231/442] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:59 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:59.677048 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-81d734e5-ada0-4dcc-a58a-b2a7e1a7a6e4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:59.677768 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-81d734e5-ada0-4dcc-a58a-b2a7e1a7a6e4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:59.685046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-81d734e5-ada0-4dcc-a58a-b2a7e1a7a6e4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:59.685577 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-81d734e5-ada0-4dcc-a58a-b2a7e1a7a6e4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:59.686443 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-81d734e5-ada0-4dcc-a58a-b2a7e1a7a6e4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:59.686943 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-81d734e5-ada0-4dcc-a58a-b2a7e1a7a6e4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:59.896362 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-cc3cac81-8530-4377-b87f-2839649e543d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:15:59.905817 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-cc3cac81-8530-4377-b87f-2839649e543d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.474734 Jun 16 21:15:59.906561 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 212/443] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:59 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:15:59.911977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-80375640-141a-4274-a436-1f69cfd663dc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:15:59.913171 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-80375640-141a-4274-a436-1f69cfd663dc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:15:59.915481 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=100 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:59.922706 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-80375640-141a-4274-a436-1f69cfd663dc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:59.923298 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-80375640-141a-4274-a436-1f69cfd663dc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:15:59.924525 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-80375640-141a-4274-a436-1f69cfd663dc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:15:59.925457 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-80375640-141a-4274-a436-1f69cfd663dc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:00.034872 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-81d734e5-ada0-4dcc-a58a-b2a7e1a7a6e4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:00.043399 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-81d734e5-ada0-4dcc-a58a-b2a7e1a7a6e4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.370102 Jun 16 21:16:00.044003 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 232/444] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:15:59 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:00.179875 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-c9c34729-1c93-45e8-bc03-292a0b736329 req-aec428f8-066d-48ac-8363-9e7bcf8eb134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1203965c-d902-4af7-99a1-308d7d5a6159", "name": "network-vif-deleted", "tag": "6f8829ec-9941-48af-93e2-a733042b82bb"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:00.181335 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-80375640-141a-4274-a436-1f69cfd663dc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:00.187984 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-c9c34729-1c93-45e8-bc03-292a0b736329 req-aec428f8-066d-48ac-8363-9e7bcf8eb134 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:00.188458 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-c9c34729-1c93-45e8-bc03-292a0b736329 req-aec428f8-066d-48ac-8363-9e7bcf8eb134 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:00.189829 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-80375640-141a-4274-a436-1f69cfd663dc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:00.191334 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-80375640-141a-4274-a436-1f69cfd663dc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:00.192561 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-80375640-141a-4274-a436-1f69cfd663dc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1719 microversion: 2.20 time: 0.284524 Jun 16 21:16:00.193117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 213/445] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:15:59 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1719 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:00.199313 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-c9c34729-1c93-45e8-bc03-292a0b736329 req-aec428f8-066d-48ac-8363-9e7bcf8eb134 service nova] Creating event network-vif-deleted:6f8829ec-9941-48af-93e2-a733042b82bb for instance 1203965c-d902-4af7-99a1-308d7d5a6159 on hv-cinder-81914 Jun 16 21:16:00.204354 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-c9c34729-1c93-45e8-bc03-292a0b736329 req-aec428f8-066d-48ac-8363-9e7bcf8eb134 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029072 Jun 16 21:16:00.204912 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 233/446] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:16:00.422616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-572075ee-7172-4c45-82d4-28023acd0066 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:00.423146 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-572075ee-7172-4c45-82d4-28023acd0066 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:00.430722 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-572075ee-7172-4c45-82d4-28023acd0066 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:00.431167 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-572075ee-7172-4c45-82d4-28023acd0066 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:00.431920 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-572075ee-7172-4c45-82d4-28023acd0066 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:00.432387 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-572075ee-7172-4c45-82d4-28023acd0066 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:00.494868 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-572075ee-7172-4c45-82d4-28023acd0066 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:00.502244 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-572075ee-7172-4c45-82d4-28023acd0066 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1472 microversion: 2.1 time: 0.083812 Jun 16 21:16:00.502806 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 214/447] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:00 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1472 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:00.563969 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7003e681-cc08-4fbd-a7b5-a64baf2b71b5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:00.564700 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7003e681-cc08-4fbd-a7b5-a64baf2b71b5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:00.571584 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7003e681-cc08-4fbd-a7b5-a64baf2b71b5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:00.572029 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7003e681-cc08-4fbd-a7b5-a64baf2b71b5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:00.572991 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7003e681-cc08-4fbd-a7b5-a64baf2b71b5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:00.573427 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7003e681-cc08-4fbd-a7b5-a64baf2b71b5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:00.703875 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7003e681-cc08-4fbd-a7b5-a64baf2b71b5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:00.711960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7003e681-cc08-4fbd-a7b5-a64baf2b71b5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.152324 Jun 16 21:16:00.712546 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 234/448] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:00 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:00.923815 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-be411eee-35e1-4a72-af1a-20c7d819b0df tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:00.924469 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-be411eee-35e1-4a72-af1a-20c7d819b0df tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:00.931362 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-be411eee-35e1-4a72-af1a-20c7d819b0df tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:00.931796 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-be411eee-35e1-4a72-af1a-20c7d819b0df tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:00.932644 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-be411eee-35e1-4a72-af1a-20c7d819b0df tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:00.933072 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-be411eee-35e1-4a72-af1a-20c7d819b0df tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:01.060120 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d9abb0c5-5ba6-4d89-8a2d-1350cb2a4884 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:01.060790 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d9abb0c5-5ba6-4d89-8a2d-1350cb2a4884 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:01.066877 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d9abb0c5-5ba6-4d89-8a2d-1350cb2a4884 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:01.067153 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d9abb0c5-5ba6-4d89-8a2d-1350cb2a4884 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:01.067908 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d9abb0c5-5ba6-4d89-8a2d-1350cb2a4884 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:01.068364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d9abb0c5-5ba6-4d89-8a2d-1350cb2a4884 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:01.069669 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-be411eee-35e1-4a72-af1a-20c7d819b0df tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:01.078325 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-be411eee-35e1-4a72-af1a-20c7d819b0df tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.158329 Jun 16 21:16:01.078905 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 215/449] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:00 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:01.210952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b0509ed3-0fd9-42fc-baf8-2dca80df488a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:01.211571 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b0509ed3-0fd9-42fc-baf8-2dca80df488a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:01.217620 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b0509ed3-0fd9-42fc-baf8-2dca80df488a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:01.218134 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b0509ed3-0fd9-42fc-baf8-2dca80df488a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:01.218902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b0509ed3-0fd9-42fc-baf8-2dca80df488a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:01.219422 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b0509ed3-0fd9-42fc-baf8-2dca80df488a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:01.331947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d9abb0c5-5ba6-4d89-8a2d-1350cb2a4884 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:01.345920 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d9abb0c5-5ba6-4d89-8a2d-1350cb2a4884 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.289563 Jun 16 21:16:01.357209 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 235/450] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:01 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:01.396495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b0509ed3-0fd9-42fc-baf8-2dca80df488a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:01.406124 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b0509ed3-0fd9-42fc-baf8-2dca80df488a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:01.407736 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b0509ed3-0fd9-42fc-baf8-2dca80df488a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:01.409029 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b0509ed3-0fd9-42fc-baf8-2dca80df488a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1719 microversion: 2.20 time: 0.202672 Jun 16 21:16:01.409664 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 216/451] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:01 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1719 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:16:01.518777 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7d1853e8-fb8a-4e31-88cd-4e87291d82cc tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:01.519379 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7d1853e8-fb8a-4e31-88cd-4e87291d82cc tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:01.525554 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7d1853e8-fb8a-4e31-88cd-4e87291d82cc tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:01.525992 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7d1853e8-fb8a-4e31-88cd-4e87291d82cc tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:01.526734 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7d1853e8-fb8a-4e31-88cd-4e87291d82cc tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:01.527163 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7d1853e8-fb8a-4e31-88cd-4e87291d82cc tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:01.557201 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7d1853e8-fb8a-4e31-88cd-4e87291d82cc tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:01.557630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7d1853e8-fb8a-4e31-88cd-4e87291d82cc tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:01.558061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.objects.instance [None req-7d1853e8-fb8a-4e31-88cd-4e87291d82cc tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lazy-loading 'fault' on Instance uuid 1203965c-d902-4af7-99a1-308d7d5a6159 {{(pid=117737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:16:01.601939 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7d1853e8-fb8a-4e31-88cd-4e87291d82cc tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:01.605442 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=100 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:01.611017 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7d1853e8-fb8a-4e31-88cd-4e87291d82cc tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 200 len: 1309 microversion: 2.1 time: 0.096090 Jun 16 21:16:01.611581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 236/452] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:01 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:01.729476 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-25c9a256-1c79-441b-97d0-d582f0c694c0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:01.730072 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-25c9a256-1c79-441b-97d0-d582f0c694c0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:01.736580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-25c9a256-1c79-441b-97d0-d582f0c694c0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:01.737017 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-25c9a256-1c79-441b-97d0-d582f0c694c0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:01.737764 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-25c9a256-1c79-441b-97d0-d582f0c694c0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:01.738513 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-25c9a256-1c79-441b-97d0-d582f0c694c0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:01.865951 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-25c9a256-1c79-441b-97d0-d582f0c694c0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:01.873337 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-25c9a256-1c79-441b-97d0-d582f0c694c0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.148378 Jun 16 21:16:01.873926 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 217/453] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:01 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:02.096964 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d30645c6-d185-452b-bf78-7f327191d94f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:02.097774 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d30645c6-d185-452b-bf78-7f327191d94f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:02.105241 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d30645c6-d185-452b-bf78-7f327191d94f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:02.105768 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d30645c6-d185-452b-bf78-7f327191d94f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:02.106798 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d30645c6-d185-452b-bf78-7f327191d94f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:02.107360 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d30645c6-d185-452b-bf78-7f327191d94f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:02.315735 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d30645c6-d185-452b-bf78-7f327191d94f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:02.325326 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d30645c6-d185-452b-bf78-7f327191d94f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.232398 Jun 16 21:16:02.325905 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 237/454] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:02 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:02.364667 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b1f66f4b-abc1-4fe0-a9d2-002c6059ec67 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:02.365308 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b1f66f4b-abc1-4fe0-a9d2-002c6059ec67 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:02.374880 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b1f66f4b-abc1-4fe0-a9d2-002c6059ec67 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:02.375274 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b1f66f4b-abc1-4fe0-a9d2-002c6059ec67 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:02.375995 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b1f66f4b-abc1-4fe0-a9d2-002c6059ec67 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:02.376573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b1f66f4b-abc1-4fe0-a9d2-002c6059ec67 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:02.428597 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-3187c6df-e972-4139-b22b-3cdde9193a54 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:02.429203 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-3187c6df-e972-4139-b22b-3cdde9193a54 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:02.435248 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3187c6df-e972-4139-b22b-3cdde9193a54 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:02.435686 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3187c6df-e972-4139-b22b-3cdde9193a54 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:02.436463 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3187c6df-e972-4139-b22b-3cdde9193a54 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:02.436887 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3187c6df-e972-4139-b22b-3cdde9193a54 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:02.520228 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b1f66f4b-abc1-4fe0-a9d2-002c6059ec67 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:02.534687 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b1f66f4b-abc1-4fe0-a9d2-002c6059ec67 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.174858 Jun 16 21:16:02.535500 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 218/455] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:02 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:02.581628 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3187c6df-e972-4139-b22b-3cdde9193a54 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:02.590877 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3187c6df-e972-4139-b22b-3cdde9193a54 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:02.592447 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3187c6df-e972-4139-b22b-3cdde9193a54 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:02.593699 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-3187c6df-e972-4139-b22b-3cdde9193a54 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1662 microversion: 2.20 time: 0.169110 Jun 16 21:16:02.597388 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 238/456] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:02 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:02.613755 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-324bae5a-314c-4e72-9578-6b2439c46055 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed9a9fdf-96c4-4bd0-8e16-817d190ed4b5"}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:02.614878 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-324bae5a-314c-4e72-9578-6b2439c46055 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:02.621639 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-324bae5a-314c-4e72-9578-6b2439c46055 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:02.622088 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-324bae5a-314c-4e72-9578-6b2439c46055 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:02.622865 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-324bae5a-314c-4e72-9578-6b2439c46055 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:02.623295 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-324bae5a-314c-4e72-9578-6b2439c46055 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:02.629870 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-26573a10-345e-4798-9661-f5c333fe8d90 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:02.630649 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-26573a10-345e-4798-9661-f5c333fe8d90 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1203965c-d902-4af7-99a1-308d7d5a6159] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:02.637524 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-26573a10-345e-4798-9661-f5c333fe8d90 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:02.637970 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-26573a10-345e-4798-9661-f5c333fe8d90 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:02.639000 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-26573a10-345e-4798-9661-f5c333fe8d90 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:02.639436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-26573a10-345e-4798-9661-f5c333fe8d90 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:02.659332 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-26573a10-345e-4798-9661-f5c333fe8d90 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] HTTP exception thrown: Instance 1203965c-d902-4af7-99a1-308d7d5a6159 could not be found. Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-26573a10-345e-4798-9661-f5c333fe8d90 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Request method failure captured: Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 HTTP/1.1 Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq50tFRUmFNsVSBR2vfMPs79UxDXGMhq9P5CN_v0QkV6PXJh1sOtnGfUgWEPWIz_GxFx8Dizyq2p3AynUMplSq-VTXmNDEsGY3TLPznJNy630a9cJoz_Sz4GVrvp84BOV5VCdG4FXCzL-nL0pi0LyUEOdCRybudgHKqIne0_EC2IDyFo Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 0a667c6d13514cc4bdaaf4598bc723d4 Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-VolumesSnapshotTestJSON-81585281 Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:16:02.661465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:16:02.663610 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0a667c6d13514cc4bdaaf4598bc723d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0a667c6d13514cc4bdaaf4598bc723d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0a667c6d13514cc4bdaaf4598bc723d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0a667c6d13514cc4bdaaf4598bc723d4"}]}] Jun 16 21:16:02.663610 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-VolumesSnapshotTestJSON-81585281 Jun 16 21:16:02.663610 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 0a667c6d13514cc4bdaaf4598bc723d4 Jun 16 21:16:02.663610 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-81585281 Jun 16 21:16:02.663610 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-VolumesSnapshotTestJSON-81585281-project Jun 16 21:16:02.663610 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:16:02.663610 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:16:02.663610 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 2d1d69a29709455d9d9dc596ecbb870d Jun 16 21:16:02.663610 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-VolumesSnapshotTestJSON-81585281-project Jun 16 21:16:02.663610 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:16:02.663610 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 1203965c-d902-4af7-99a1-308d7d5a6159 could not be found. Jun 16 21:16:02.663610 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '1203965c-d902-4af7-99a1-308d7d5a6159'} Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1203965c-d902-4af7-99a1-308d7d5a6159 could not be found. Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:16:02.664802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1203965c-d902-4af7-99a1-308d7d5a6159 could not be found. Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1203965c-d902-4af7-99a1-308d7d5a6159 could not be found. Jun 16 21:16:02.666287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:16:02.668418 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-26573a10-345e-4798-9661-f5c333fe8d90 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Returning 404 to user: Instance 1203965c-d902-4af7-99a1-308d7d5a6159 could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:16:02.669638 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-26573a10-345e-4798-9661-f5c333fe8d90 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159" status: 404 len: 111 microversion: 2.1 time: 0.043830 Jun 16 21:16:02.670700 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 239/457] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:02 2022] GET /compute/v2.1/servers/1203965c-d902-4af7-99a1-308d7d5a6159 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 21:16:02.892081 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-dae46d22-c986-4f74-b18f-57c6c593e482 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:02.893205 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-dae46d22-c986-4f74-b18f-57c6c593e482 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:02.900594 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dae46d22-c986-4f74-b18f-57c6c593e482 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:02.901496 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dae46d22-c986-4f74-b18f-57c6c593e482 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:02.902626 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dae46d22-c986-4f74-b18f-57c6c593e482 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:02.903283 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dae46d22-c986-4f74-b18f-57c6c593e482 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:02.963168 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-324bae5a-314c-4e72-9578-6b2439c46055 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "POST /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.353234 Jun 16 21:16:02.964350 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 219/458] 10.222.0.43 () {62 vars in 1363 bytes} [Thu Jun 16 21:16:02 2022] POST /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-volume_attachments => generated 188 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:16:03.060265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-dae46d22-c986-4f74-b18f-57c6c593e482 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:03.069888 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-dae46d22-c986-4f74-b18f-57c6c593e482 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.181609 Jun 16 21:16:03.070714 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 240/459] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:02 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:03.114534 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c50ad007-7082-44be-9979-3ad758bb7327 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:03.116333 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c50ad007-7082-44be-9979-3ad758bb7327 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:03.122567 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c50ad007-7082-44be-9979-3ad758bb7327 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:03.123426 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c50ad007-7082-44be-9979-3ad758bb7327 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:03.123777 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c50ad007-7082-44be-9979-3ad758bb7327 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:03.124229 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c50ad007-7082-44be-9979-3ad758bb7327 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:03.213645 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c50ad007-7082-44be-9979-3ad758bb7327 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "POST /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/action" status: 202 len: 0 microversion: 2.20 time: 0.103188 Jun 16 21:16:03.214248 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 220/460] 10.222.0.43 () {62 vars in 1318 bytes} [Thu Jun 16 21:16:03 2022] POST /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:16:03.222527 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-61cc6f00-4ed5-4025-8cfb-3fde8a80a740 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:03.223166 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-61cc6f00-4ed5-4025-8cfb-3fde8a80a740 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:03.230003 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-61cc6f00-4ed5-4025-8cfb-3fde8a80a740 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:03.230451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-61cc6f00-4ed5-4025-8cfb-3fde8a80a740 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:03.231236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-61cc6f00-4ed5-4025-8cfb-3fde8a80a740 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:03.231664 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-61cc6f00-4ed5-4025-8cfb-3fde8a80a740 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:03.342699 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-ccce5849-084e-49df-bd95-e0891f7d8b3c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:03.343309 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-ccce5849-084e-49df-bd95-e0891f7d8b3c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:03.349322 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ccce5849-084e-49df-bd95-e0891f7d8b3c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:03.349819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ccce5849-084e-49df-bd95-e0891f7d8b3c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:03.351226 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ccce5849-084e-49df-bd95-e0891f7d8b3c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:03.351603 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ccce5849-084e-49df-bd95-e0891f7d8b3c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:03.370083 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-61cc6f00-4ed5-4025-8cfb-3fde8a80a740 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:03.379863 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-61cc6f00-4ed5-4025-8cfb-3fde8a80a740 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:03.382390 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-61cc6f00-4ed5-4025-8cfb-3fde8a80a740 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:03.383640 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-61cc6f00-4ed5-4025-8cfb-3fde8a80a740 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1748 microversion: 2.20 time: 0.165213 Jun 16 21:16:03.384633 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 241/461] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:03 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:16:03.488663 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-ccce5849-084e-49df-bd95-e0891f7d8b3c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:03.497594 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-ccce5849-084e-49df-bd95-e0891f7d8b3c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.158718 Jun 16 21:16:03.498162 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 221/462] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:03 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:03.551751 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e81f1960-2453-4acc-9491-16483f079da6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:03.552524 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e81f1960-2453-4acc-9491-16483f079da6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:03.559150 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e81f1960-2453-4acc-9491-16483f079da6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:03.559670 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e81f1960-2453-4acc-9491-16483f079da6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:03.560535 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e81f1960-2453-4acc-9491-16483f079da6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:03.561050 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e81f1960-2453-4acc-9491-16483f079da6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:03.696037 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e81f1960-2453-4acc-9491-16483f079da6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:03.703462 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e81f1960-2453-4acc-9491-16483f079da6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.155612 Jun 16 21:16:03.704101 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 242/463] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:03 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:04.088040 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-469c6dea-068e-43ab-a5f7-505e4f4d12dc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:04.088690 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-469c6dea-068e-43ab-a5f7-505e4f4d12dc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:04.095428 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-469c6dea-068e-43ab-a5f7-505e4f4d12dc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:04.095884 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-469c6dea-068e-43ab-a5f7-505e4f4d12dc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:04.096716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-469c6dea-068e-43ab-a5f7-505e4f4d12dc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:04.097152 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-469c6dea-068e-43ab-a5f7-505e4f4d12dc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:04.241735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-469c6dea-068e-43ab-a5f7-505e4f4d12dc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:04.249729 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-469c6dea-068e-43ab-a5f7-505e4f4d12dc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.166785 Jun 16 21:16:04.250304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 222/464] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:04 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:04.401954 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c144aff8-917f-4dc1-b555-348e6b984f71 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:04.402556 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c144aff8-917f-4dc1-b555-348e6b984f71 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:04.408640 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c144aff8-917f-4dc1-b555-348e6b984f71 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:04.409074 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c144aff8-917f-4dc1-b555-348e6b984f71 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:04.409824 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c144aff8-917f-4dc1-b555-348e6b984f71 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:04.410245 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c144aff8-917f-4dc1-b555-348e6b984f71 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:04.514794 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3a8e5c3f-f5ab-46a9-b80b-d0f4d933bb98 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:04.515564 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-3a8e5c3f-f5ab-46a9-b80b-d0f4d933bb98 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:04.522107 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3a8e5c3f-f5ab-46a9-b80b-d0f4d933bb98 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:04.522557 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3a8e5c3f-f5ab-46a9-b80b-d0f4d933bb98 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:04.523326 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3a8e5c3f-f5ab-46a9-b80b-d0f4d933bb98 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:04.523760 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3a8e5c3f-f5ab-46a9-b80b-d0f4d933bb98 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:04.541852 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c144aff8-917f-4dc1-b555-348e6b984f71 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:04.550250 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c144aff8-917f-4dc1-b555-348e6b984f71 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:04.551856 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c144aff8-917f-4dc1-b555-348e6b984f71 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:04.553651 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c144aff8-917f-4dc1-b555-348e6b984f71 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1748 microversion: 2.20 time: 0.155139 Jun 16 21:16:04.554210 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 243/465] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:04 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:04.652513 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-3a8e5c3f-f5ab-46a9-b80b-d0f4d933bb98 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:04.660401 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-3a8e5c3f-f5ab-46a9-b80b-d0f4d933bb98 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.149478 Jun 16 21:16:04.660965 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 223/466] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:04 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:04.719080 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-fa559b23-66a4-40ac-8726-f50f94832a6e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:04.719677 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-fa559b23-66a4-40ac-8726-f50f94832a6e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:04.726338 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fa559b23-66a4-40ac-8726-f50f94832a6e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:04.726772 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fa559b23-66a4-40ac-8726-f50f94832a6e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:04.727516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fa559b23-66a4-40ac-8726-f50f94832a6e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:04.727938 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fa559b23-66a4-40ac-8726-f50f94832a6e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:04.856828 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-fa559b23-66a4-40ac-8726-f50f94832a6e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:04.864512 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-fa559b23-66a4-40ac-8726-f50f94832a6e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.149125 Jun 16 21:16:04.865070 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 244/467] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:04 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:05.267737 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c297e8b1-f662-43a6-b68e-0ac525b12dd9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:05.268380 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c297e8b1-f662-43a6-b68e-0ac525b12dd9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:05.275530 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c297e8b1-f662-43a6-b68e-0ac525b12dd9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:05.275955 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c297e8b1-f662-43a6-b68e-0ac525b12dd9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:05.276742 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c297e8b1-f662-43a6-b68e-0ac525b12dd9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:05.277169 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c297e8b1-f662-43a6-b68e-0ac525b12dd9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:05.293952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:05.414060 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c297e8b1-f662-43a6-b68e-0ac525b12dd9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:05.421475 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c297e8b1-f662-43a6-b68e-0ac525b12dd9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.157637 Jun 16 21:16:05.422044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 224/468] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:05 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:05.572307 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7a30ce20-1282-41eb-8911-ed2210f2f45e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:05.572907 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7a30ce20-1282-41eb-8911-ed2210f2f45e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:05.578983 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7a30ce20-1282-41eb-8911-ed2210f2f45e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:05.579417 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7a30ce20-1282-41eb-8911-ed2210f2f45e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:05.580161 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7a30ce20-1282-41eb-8911-ed2210f2f45e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:05.580612 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7a30ce20-1282-41eb-8911-ed2210f2f45e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:05.677564 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5a633fca-5fd4-4c5a-ab32-64bafabc253c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:05.679285 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5a633fca-5fd4-4c5a-ab32-64bafabc253c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:05.686087 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5a633fca-5fd4-4c5a-ab32-64bafabc253c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:05.686663 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5a633fca-5fd4-4c5a-ab32-64bafabc253c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:05.687350 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5a633fca-5fd4-4c5a-ab32-64bafabc253c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:05.687793 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5a633fca-5fd4-4c5a-ab32-64bafabc253c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:05.718056 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7a30ce20-1282-41eb-8911-ed2210f2f45e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:05.727060 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7a30ce20-1282-41eb-8911-ed2210f2f45e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:05.728658 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7a30ce20-1282-41eb-8911-ed2210f2f45e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:05.729828 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7a30ce20-1282-41eb-8911-ed2210f2f45e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1748 microversion: 2.20 time: 0.161835 Jun 16 21:16:05.730383 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 245/469] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:05 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:05.818340 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5a633fca-5fd4-4c5a-ab32-64bafabc253c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:05.826293 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5a633fca-5fd4-4c5a-ab32-64bafabc253c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.152557 Jun 16 21:16:05.826857 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 225/470] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:05 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:05.882526 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-2cd36822-932a-4454-a89c-5afd86f72184 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:05.883142 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-2cd36822-932a-4454-a89c-5afd86f72184 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:05.889105 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2cd36822-932a-4454-a89c-5afd86f72184 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:05.889551 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2cd36822-932a-4454-a89c-5afd86f72184 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:05.890309 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2cd36822-932a-4454-a89c-5afd86f72184 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:05.890740 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2cd36822-932a-4454-a89c-5afd86f72184 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:06.020979 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2cd36822-932a-4454-a89c-5afd86f72184 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:06.029195 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-2cd36822-932a-4454-a89c-5afd86f72184 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.150888 Jun 16 21:16:06.029766 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 246/471] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:05 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:06.438004 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1aaf3703-dc41-4db8-b0d8-e5772e8c64f0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:06.438810 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1aaf3703-dc41-4db8-b0d8-e5772e8c64f0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:06.446063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1aaf3703-dc41-4db8-b0d8-e5772e8c64f0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:06.446510 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1aaf3703-dc41-4db8-b0d8-e5772e8c64f0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:06.447273 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1aaf3703-dc41-4db8-b0d8-e5772e8c64f0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:06.447716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1aaf3703-dc41-4db8-b0d8-e5772e8c64f0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:06.554232 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-93cc890c-6f33-47bd-a2d6-7b6423ea14cf req-ce72f87f-8d95-4ee3-9da0-9fb61ad8339e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec1e2cd-9bb8-4602-9f96-77478cfc9af8", "name": "network-vif-plugged", "status": "completed", "tag": "f26fce3f-5e61-4002-98b6-275c3b72e9db"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:06.562334 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-93cc890c-6f33-47bd-a2d6-7b6423ea14cf req-ce72f87f-8d95-4ee3-9da0-9fb61ad8339e service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:06.562925 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-93cc890c-6f33-47bd-a2d6-7b6423ea14cf req-ce72f87f-8d95-4ee3-9da0-9fb61ad8339e service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:06.575366 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-93cc890c-6f33-47bd-a2d6-7b6423ea14cf req-ce72f87f-8d95-4ee3-9da0-9fb61ad8339e service nova] Creating event network-vif-plugged:f26fce3f-5e61-4002-98b6-275c3b72e9db for instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 on hv-cinder-81914 Jun 16 21:16:06.580573 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-93cc890c-6f33-47bd-a2d6-7b6423ea14cf req-ce72f87f-8d95-4ee3-9da0-9fb61ad8339e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032206 Jun 16 21:16:06.581557 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 247/472] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:16:06.594014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1aaf3703-dc41-4db8-b0d8-e5772e8c64f0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:06.613208 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1aaf3703-dc41-4db8-b0d8-e5772e8c64f0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.178362 Jun 16 21:16:06.613973 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 226/473] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:06 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:06.749849 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-939dff57-4358-4cb0-89c1-ab5088a0a9b8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:06.750535 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-939dff57-4358-4cb0-89c1-ab5088a0a9b8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:06.757326 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-939dff57-4358-4cb0-89c1-ab5088a0a9b8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:06.757761 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-939dff57-4358-4cb0-89c1-ab5088a0a9b8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:06.758535 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-939dff57-4358-4cb0-89c1-ab5088a0a9b8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:06.758982 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-939dff57-4358-4cb0-89c1-ab5088a0a9b8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:06.845999 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-e319995b-d9e1-45c6-8bad-043cade64d6a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:06.847472 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-e319995b-d9e1-45c6-8bad-043cade64d6a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:06.855011 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e319995b-d9e1-45c6-8bad-043cade64d6a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:06.855519 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e319995b-d9e1-45c6-8bad-043cade64d6a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:06.856444 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e319995b-d9e1-45c6-8bad-043cade64d6a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:06.857144 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e319995b-d9e1-45c6-8bad-043cade64d6a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:06.951259 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-939dff57-4358-4cb0-89c1-ab5088a0a9b8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:06.960753 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-939dff57-4358-4cb0-89c1-ab5088a0a9b8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:06.962489 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-939dff57-4358-4cb0-89c1-ab5088a0a9b8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:06.963932 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-939dff57-4358-4cb0-89c1-ab5088a0a9b8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1750 microversion: 2.20 time: 0.218738 Jun 16 21:16:06.976095 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 248/474] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:06 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1750 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:07.003329 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-e319995b-d9e1-45c6-8bad-043cade64d6a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:07.014656 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-e319995b-d9e1-45c6-8bad-043cade64d6a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.174198 Jun 16 21:16:07.015299 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 227/475] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:06 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:07.045217 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8b618df8-c832-4bdf-a4a9-323129d7d681 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:07.045820 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8b618df8-c832-4bdf-a4a9-323129d7d681 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:07.051601 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8b618df8-c832-4bdf-a4a9-323129d7d681 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:07.052041 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8b618df8-c832-4bdf-a4a9-323129d7d681 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:07.053431 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8b618df8-c832-4bdf-a4a9-323129d7d681 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:07.053867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8b618df8-c832-4bdf-a4a9-323129d7d681 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:07.201556 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8b618df8-c832-4bdf-a4a9-323129d7d681 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:07.211593 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8b618df8-c832-4bdf-a4a9-323129d7d681 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.170055 Jun 16 21:16:07.212821 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 249/476] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:07 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:07.630720 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c075ab20-aa26-4f12-8728-625d0436cd20 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:07.631726 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c075ab20-aa26-4f12-8728-625d0436cd20 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:07.637913 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c075ab20-aa26-4f12-8728-625d0436cd20 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:07.638366 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c075ab20-aa26-4f12-8728-625d0436cd20 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:07.639135 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c075ab20-aa26-4f12-8728-625d0436cd20 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:07.639570 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c075ab20-aa26-4f12-8728-625d0436cd20 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:07.770825 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c075ab20-aa26-4f12-8728-625d0436cd20 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:07.778299 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c075ab20-aa26-4f12-8728-625d0436cd20 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.151416 Jun 16 21:16:07.778866 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 228/477] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:07 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:07.983011 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5c2b263f-d427-487a-bcd0-5083c117bde2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:07.983567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5c2b263f-d427-487a-bcd0-5083c117bde2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:07.990592 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5c2b263f-d427-487a-bcd0-5083c117bde2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:07.991028 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5c2b263f-d427-487a-bcd0-5083c117bde2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:07.992348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5c2b263f-d427-487a-bcd0-5083c117bde2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:07.992773 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5c2b263f-d427-487a-bcd0-5083c117bde2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:08.031945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7950fa55-ec1f-4ac2-963f-e060ff8cb352 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:08.032564 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7950fa55-ec1f-4ac2-963f-e060ff8cb352 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:08.039176 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7950fa55-ec1f-4ac2-963f-e060ff8cb352 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:08.039617 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7950fa55-ec1f-4ac2-963f-e060ff8cb352 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:08.040412 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7950fa55-ec1f-4ac2-963f-e060ff8cb352 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:08.040846 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7950fa55-ec1f-4ac2-963f-e060ff8cb352 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:08.176086 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-7950fa55-ec1f-4ac2-963f-e060ff8cb352 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:08.185816 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7950fa55-ec1f-4ac2-963f-e060ff8cb352 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.157602 Jun 16 21:16:08.186583 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 229/478] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:08 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:08.229923 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7e4da919-d73c-493c-b797-c4c50018c933 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:08.230606 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7e4da919-d73c-493c-b797-c4c50018c933 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:08.236828 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7e4da919-d73c-493c-b797-c4c50018c933 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:08.237286 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7e4da919-d73c-493c-b797-c4c50018c933 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:08.238696 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7e4da919-d73c-493c-b797-c4c50018c933 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:08.239132 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7e4da919-d73c-493c-b797-c4c50018c933 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:08.291571 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5c2b263f-d427-487a-bcd0-5083c117bde2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:08.301527 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5c2b263f-d427-487a-bcd0-5083c117bde2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:08.303292 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5c2b263f-d427-487a-bcd0-5083c117bde2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:08.305538 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5c2b263f-d427-487a-bcd0-5083c117bde2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.326444 Jun 16 21:16:08.306650 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 250/479] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:07 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:08.383695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-7e4da919-d73c-493c-b797-c4c50018c933 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:08.394806 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7e4da919-d73c-493c-b797-c4c50018c933 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.169767 Jun 16 21:16:08.395743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 230/480] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:08 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:08.795722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-873adf6a-f2b2-4732-b8fe-f1925af6557d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:08.796357 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-873adf6a-f2b2-4732-b8fe-f1925af6557d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:08.802267 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-873adf6a-f2b2-4732-b8fe-f1925af6557d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:08.802697 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-873adf6a-f2b2-4732-b8fe-f1925af6557d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:08.803444 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-873adf6a-f2b2-4732-b8fe-f1925af6557d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:08.804691 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-873adf6a-f2b2-4732-b8fe-f1925af6557d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:08.931621 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-873adf6a-f2b2-4732-b8fe-f1925af6557d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:08.939144 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-873adf6a-f2b2-4732-b8fe-f1925af6557d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.147821 Jun 16 21:16:08.939700 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 251/481] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:08 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:09.203178 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-47177d02-c0af-4dd5-a5a5-5930cf60af6e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:09.203781 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-47177d02-c0af-4dd5-a5a5-5930cf60af6e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:09.211095 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-47177d02-c0af-4dd5-a5a5-5930cf60af6e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:09.211535 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-47177d02-c0af-4dd5-a5a5-5930cf60af6e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:09.212565 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-47177d02-c0af-4dd5-a5a5-5930cf60af6e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:09.212990 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-47177d02-c0af-4dd5-a5a5-5930cf60af6e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:09.323965 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4af68aa1-1e42-4bf6-9ed1-18cf6f6aa22a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:09.324740 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4af68aa1-1e42-4bf6-9ed1-18cf6f6aa22a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:09.331817 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4af68aa1-1e42-4bf6-9ed1-18cf6f6aa22a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:09.332288 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4af68aa1-1e42-4bf6-9ed1-18cf6f6aa22a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:09.333056 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4af68aa1-1e42-4bf6-9ed1-18cf6f6aa22a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:09.333477 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4af68aa1-1e42-4bf6-9ed1-18cf6f6aa22a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:09.349188 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-47177d02-c0af-4dd5-a5a5-5930cf60af6e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:09.358062 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-47177d02-c0af-4dd5-a5a5-5930cf60af6e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.158610 Jun 16 21:16:09.358637 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 231/482] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:09 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:09.412262 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d9a74739-53a8-4f97-a611-791547fbb40c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:09.412878 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d9a74739-53a8-4f97-a611-791547fbb40c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:09.419792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9a74739-53a8-4f97-a611-791547fbb40c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:09.420276 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9a74739-53a8-4f97-a611-791547fbb40c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:09.421099 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9a74739-53a8-4f97-a611-791547fbb40c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:09.421540 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9a74739-53a8-4f97-a611-791547fbb40c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:09.471139 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4af68aa1-1e42-4bf6-9ed1-18cf6f6aa22a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:09.478258 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4af68aa1-1e42-4bf6-9ed1-18cf6f6aa22a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:09.479756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4af68aa1-1e42-4bf6-9ed1-18cf6f6aa22a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:09.481143 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4af68aa1-1e42-4bf6-9ed1-18cf6f6aa22a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.161113 Jun 16 21:16:09.481727 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 252/483] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:09 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:09.552783 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d9a74739-53a8-4f97-a611-791547fbb40c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:09.560459 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d9a74739-53a8-4f97-a611-791547fbb40c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.152115 Jun 16 21:16:09.561037 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 232/484] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:09 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:09.956486 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-6c290a43-2e60-40d5-b218-6af6a0083832 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:09.957103 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-6c290a43-2e60-40d5-b218-6af6a0083832 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:09.964213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6c290a43-2e60-40d5-b218-6af6a0083832 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:09.964658 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6c290a43-2e60-40d5-b218-6af6a0083832 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:09.965420 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6c290a43-2e60-40d5-b218-6af6a0083832 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:09.965851 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6c290a43-2e60-40d5-b218-6af6a0083832 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:10.091783 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6c290a43-2e60-40d5-b218-6af6a0083832 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:10.100552 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-6c290a43-2e60-40d5-b218-6af6a0083832 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.147925 Jun 16 21:16:10.101122 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 253/485] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:09 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:10.374783 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4bfdd427-674b-4a38-abd9-dfe35aa51889 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:10.375425 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4bfdd427-674b-4a38-abd9-dfe35aa51889 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:10.381967 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4bfdd427-674b-4a38-abd9-dfe35aa51889 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:10.382417 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4bfdd427-674b-4a38-abd9-dfe35aa51889 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:10.383239 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4bfdd427-674b-4a38-abd9-dfe35aa51889 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:10.383677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4bfdd427-674b-4a38-abd9-dfe35aa51889 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:10.499522 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e56eb0fe-5cac-40e2-b033-cf208cca6d8c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:10.500244 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e56eb0fe-5cac-40e2-b033-cf208cca6d8c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:10.506738 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e56eb0fe-5cac-40e2-b033-cf208cca6d8c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:10.508208 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e56eb0fe-5cac-40e2-b033-cf208cca6d8c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:10.509050 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e56eb0fe-5cac-40e2-b033-cf208cca6d8c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:10.509569 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e56eb0fe-5cac-40e2-b033-cf208cca6d8c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:10.525069 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4bfdd427-674b-4a38-abd9-dfe35aa51889 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:10.533285 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4bfdd427-674b-4a38-abd9-dfe35aa51889 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.162336 Jun 16 21:16:10.533853 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 233/486] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:10 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:10.577261 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b280d951-b176-4c1f-8445-aa01d0ca3acc tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:10.577979 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b280d951-b176-4c1f-8445-aa01d0ca3acc tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:10.586116 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b280d951-b176-4c1f-8445-aa01d0ca3acc tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:10.586605 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b280d951-b176-4c1f-8445-aa01d0ca3acc tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:10.587392 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b280d951-b176-4c1f-8445-aa01d0ca3acc tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:10.587826 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b280d951-b176-4c1f-8445-aa01d0ca3acc tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:10.652226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e56eb0fe-5cac-40e2-b033-cf208cca6d8c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:10.655708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=100 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:10.662197 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e56eb0fe-5cac-40e2-b033-cf208cca6d8c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:10.664012 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e56eb0fe-5cac-40e2-b033-cf208cca6d8c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:10.665234 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e56eb0fe-5cac-40e2-b033-cf208cca6d8c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.169556 Jun 16 21:16:10.665805 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 254/487] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:10 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:16:10.728273 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b280d951-b176-4c1f-8445-aa01d0ca3acc tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:10.735618 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b280d951-b176-4c1f-8445-aa01d0ca3acc tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1359 microversion: 2.1 time: 0.162195 Jun 16 21:16:10.736208 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 234/488] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:10 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:11.118216 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1ead0e6f-83f0-4ce2-bc6a-8a7956b765b4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:11.118828 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1ead0e6f-83f0-4ce2-bc6a-8a7956b765b4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:11.124992 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1ead0e6f-83f0-4ce2-bc6a-8a7956b765b4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:11.125434 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1ead0e6f-83f0-4ce2-bc6a-8a7956b765b4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:11.126188 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1ead0e6f-83f0-4ce2-bc6a-8a7956b765b4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:11.126620 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1ead0e6f-83f0-4ce2-bc6a-8a7956b765b4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:11.254487 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1ead0e6f-83f0-4ce2-bc6a-8a7956b765b4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:11.261898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1ead0e6f-83f0-4ce2-bc6a-8a7956b765b4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.148420 Jun 16 21:16:11.262453 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 255/489] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:11 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:11.552595 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-f74ca26e-8bf5-4f10-a394-c0f59a94557a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:11.555042 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-f74ca26e-8bf5-4f10-a394-c0f59a94557a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:11.566665 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f74ca26e-8bf5-4f10-a394-c0f59a94557a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:11.567394 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f74ca26e-8bf5-4f10-a394-c0f59a94557a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:11.569201 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f74ca26e-8bf5-4f10-a394-c0f59a94557a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:11.570217 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f74ca26e-8bf5-4f10-a394-c0f59a94557a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:11.635237 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-63e8f539-069d-408a-9cc8-5e7cd886d25d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1929775291", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452", "networks": [{"uuid": "6ff692fa-20d5-4084-a00f-6e1d9f9d60b1"}]}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:11.698676 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.network.neutron [None req-63e8f539-069d-408a-9cc8-5e7cd886d25d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] validate_networks() for [('6ff692fa-20d5-4084-a00f-6e1d9f9d60b1', None, None, None, None, None)] {{(pid=117737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:16:11.728620 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-f74ca26e-8bf5-4f10-a394-c0f59a94557a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:11.736787 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-f74ca26e-8bf5-4f10-a394-c0f59a94557a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.188716 Jun 16 21:16:11.737355 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 235/490] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:11 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:11.742604 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8e7b4a7a-e55c-4074-bc14-ac1e508830cf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:11.743406 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8e7b4a7a-e55c-4074-bc14-ac1e508830cf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:11.750709 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8e7b4a7a-e55c-4074-bc14-ac1e508830cf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:11.751157 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8e7b4a7a-e55c-4074-bc14-ac1e508830cf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:11.752052 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8e7b4a7a-e55c-4074-bc14-ac1e508830cf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:11.752465 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8e7b4a7a-e55c-4074-bc14-ac1e508830cf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:11.886577 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8e7b4a7a-e55c-4074-bc14-ac1e508830cf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:11.894947 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8e7b4a7a-e55c-4074-bc14-ac1e508830cf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:11.896484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8e7b4a7a-e55c-4074-bc14-ac1e508830cf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:11.898402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8e7b4a7a-e55c-4074-bc14-ac1e508830cf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.159294 Jun 16 21:16:11.899001 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 236/491] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:11 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:11.903383 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-f845e913-648a-43e3-a063-4cdaa7001335 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:11.903990 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-f845e913-648a-43e3-a063-4cdaa7001335 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:11.910440 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f845e913-648a-43e3-a063-4cdaa7001335 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:11.910884 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f845e913-648a-43e3-a063-4cdaa7001335 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:11.911660 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f845e913-648a-43e3-a063-4cdaa7001335 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:11.912097 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f845e913-648a-43e3-a063-4cdaa7001335 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:12.047114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-f845e913-648a-43e3-a063-4cdaa7001335 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:12.055540 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-f845e913-648a-43e3-a063-4cdaa7001335 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1549 microversion: 2.1 time: 0.155539 Jun 16 21:16:12.056131 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 237/492] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:11 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:12.072391 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5fb37a26-cb91-4245-a211-41f087047281 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:12.073088 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5fb37a26-cb91-4245-a211-41f087047281 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:12.079058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5fb37a26-cb91-4245-a211-41f087047281 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:12.079582 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5fb37a26-cb91-4245-a211-41f087047281 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:12.080467 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5fb37a26-cb91-4245-a211-41f087047281 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:12.080971 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5fb37a26-cb91-4245-a211-41f087047281 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:12.231654 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5fb37a26-cb91-4245-a211-41f087047281 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:12.239727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5fb37a26-cb91-4245-a211-41f087047281 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1549 microversion: 2.1 time: 0.171576 Jun 16 21:16:12.240347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 238/493] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:12 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1549 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:12.256592 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-07033fb8-6f12-469b-b7bc-fdb8f0f02005 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:12.260208 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-07033fb8-6f12-469b-b7bc-fdb8f0f02005 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:12.260983 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-07033fb8-6f12-469b-b7bc-fdb8f0f02005 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Searching by: {'deleted': False, 'project_id': 'df862b955995466a84bc189d9098d7ce'} {{(pid=117738) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 21:16:12.267906 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-07033fb8-6f12-469b-b7bc-fdb8f0f02005 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:12.268387 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-07033fb8-6f12-469b-b7bc-fdb8f0f02005 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:12.269189 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-07033fb8-6f12-469b-b7bc-fdb8f0f02005 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:12.269621 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-07033fb8-6f12-469b-b7bc-fdb8f0f02005 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:12.365725 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.multi_cell_list [None req-07033fb8-6f12-469b-b7bc-fdb8f0f02005 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117738) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 21:16:12.468725 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-07033fb8-6f12-469b-b7bc-fdb8f0f02005 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.216018 Jun 16 21:16:12.469318 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 239/494] 10.222.0.43 () {58 vars in 1124 bytes} [Thu Jun 16 21:16:12 2022] GET /compute/v2.1/servers => generated 343 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:16:12.474751 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-810e08c9-60f6-498b-a9ce-925520d69697 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:12.474751 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-810e08c9-60f6-498b-a9ce-925520d69697 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:12.480940 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-810e08c9-60f6-498b-a9ce-925520d69697 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:12.481393 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-810e08c9-60f6-498b-a9ce-925520d69697 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:12.482167 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-810e08c9-60f6-498b-a9ce-925520d69697 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:12.482601 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-810e08c9-60f6-498b-a9ce-925520d69697 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:12.514097 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-63e8f539-069d-408a-9cc8-5e7cd886d25d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Flavor limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:16:12.514522 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-63e8f539-069d-408a-9cc8-5e7cd886d25d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Image limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:16:12.514995 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-63e8f539-069d-408a-9cc8-5e7cd886d25d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Flavor pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:16:12.515460 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-63e8f539-069d-408a-9cc8-5e7cd886d25d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Image pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:16:12.515887 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-63e8f539-069d-408a-9cc8-5e7cd886d25d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:16:12.526241 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-63e8f539-069d-408a-9cc8-5e7cd886d25d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:12.526684 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-63e8f539-069d-408a-9cc8-5e7cd886d25d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:12.527514 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-63e8f539-069d-408a-9cc8-5e7cd886d25d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:12.527944 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-63e8f539-069d-408a-9cc8-5e7cd886d25d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:12.545720 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-63e8f539-069d-408a-9cc8-5e7cd886d25d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Getting quotas for project 0a667c6d13514cc4bdaaf4598bc723d4. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:16:12.550487 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-63e8f539-069d-408a-9cc8-5e7cd886d25d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Getting quotas for user 2d1d69a29709455d9d9dc596ecbb870d and project 0a667c6d13514cc4bdaaf4598bc723d4. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:16:12.563417 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-63e8f539-069d-408a-9cc8-5e7cd886d25d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Going to run 1 instances... {{(pid=117737) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:16:12.565773 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-63e8f539-069d-408a-9cc8-5e7cd886d25d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:16:12.617769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-63e8f539-069d-408a-9cc8-5e7cd886d25d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.986645 Jun 16 21:16:12.618758 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 256/495] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:16:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:16:12.624596 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-adc4f068-289a-482e-9fff-bf9a2b802a93 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:12.625263 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-adc4f068-289a-482e-9fff-bf9a2b802a93 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:12.628878 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-810e08c9-60f6-498b-a9ce-925520d69697 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:12.631000 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=100 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:12.633396 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-adc4f068-289a-482e-9fff-bf9a2b802a93 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:12.634147 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-adc4f068-289a-482e-9fff-bf9a2b802a93 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:12.634626 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-adc4f068-289a-482e-9fff-bf9a2b802a93 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:12.635059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-adc4f068-289a-482e-9fff-bf9a2b802a93 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:12.641017 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-810e08c9-60f6-498b-a9ce-925520d69697 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.170655 Jun 16 21:16:12.652446 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 240/496] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:12 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:12.657996 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8128360a-43d9-41e0-85bf-ebf66e0e1406 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:12.658611 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8128360a-43d9-41e0-85bf-ebf66e0e1406 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:12.718833 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8128360a-43d9-41e0-85bf-ebf66e0e1406 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:12.726544 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8128360a-43d9-41e0-85bf-ebf66e0e1406 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1219 microversion: 2.1 time: 0.071921 Jun 16 21:16:12.727510 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 241/497] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:12 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:12.754519 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-72b784e7-08d4-4f5e-a2fb-c436d15fd428 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:12.755200 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-72b784e7-08d4-4f5e-a2fb-c436d15fd428 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:12.761700 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-72b784e7-08d4-4f5e-a2fb-c436d15fd428 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:12.762824 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-72b784e7-08d4-4f5e-a2fb-c436d15fd428 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:12.763768 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-72b784e7-08d4-4f5e-a2fb-c436d15fd428 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:12.764497 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-72b784e7-08d4-4f5e-a2fb-c436d15fd428 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:12.807835 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-adc4f068-289a-482e-9fff-bf9a2b802a93 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:12.816115 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-adc4f068-289a-482e-9fff-bf9a2b802a93 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1549 microversion: 2.1 time: 0.195688 Jun 16 21:16:12.821104 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 257/498] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:12 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1549 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:12.923367 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7da845ae-cc64-4816-a953-ee572dd21711 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:12.924376 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7da845ae-cc64-4816-a953-ee572dd21711 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:12.930757 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-72b784e7-08d4-4f5e-a2fb-c436d15fd428 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:12.939050 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7da845ae-cc64-4816-a953-ee572dd21711 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:12.940069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7da845ae-cc64-4816-a953-ee572dd21711 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:12.940331 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-72b784e7-08d4-4f5e-a2fb-c436d15fd428 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.189419 Jun 16 21:16:12.941473 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7da845ae-cc64-4816-a953-ee572dd21711 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:12.941601 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 242/499] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:12 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:12.942380 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7da845ae-cc64-4816-a953-ee572dd21711 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:13.125488 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7da845ae-cc64-4816-a953-ee572dd21711 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:13.143655 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7da845ae-cc64-4816-a953-ee572dd21711 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:13.145454 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7da845ae-cc64-4816-a953-ee572dd21711 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:13.147106 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7da845ae-cc64-4816-a953-ee572dd21711 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.229129 Jun 16 21:16:13.148451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 258/500] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:12 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:16:13.658976 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8b1e803b-f2cf-4d7d-a304-bc2c74bde133 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:13.660440 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8b1e803b-f2cf-4d7d-a304-bc2c74bde133 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:13.668674 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8b1e803b-f2cf-4d7d-a304-bc2c74bde133 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:13.669404 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8b1e803b-f2cf-4d7d-a304-bc2c74bde133 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:13.670408 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8b1e803b-f2cf-4d7d-a304-bc2c74bde133 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:13.671112 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8b1e803b-f2cf-4d7d-a304-bc2c74bde133 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:13.746056 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0582bf66-c5e7-4da8-b1e5-fb1ad9991685 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:13.746941 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0582bf66-c5e7-4da8-b1e5-fb1ad9991685 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:13.753517 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0582bf66-c5e7-4da8-b1e5-fb1ad9991685 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:13.753960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0582bf66-c5e7-4da8-b1e5-fb1ad9991685 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:13.754737 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0582bf66-c5e7-4da8-b1e5-fb1ad9991685 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:13.755174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0582bf66-c5e7-4da8-b1e5-fb1ad9991685 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:13.814465 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8b1e803b-f2cf-4d7d-a304-bc2c74bde133 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:13.822689 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8b1e803b-f2cf-4d7d-a304-bc2c74bde133 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.167509 Jun 16 21:16:13.823265 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 243/501] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:13 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:13.860747 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0582bf66-c5e7-4da8-b1e5-fb1ad9991685 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:13.871192 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0582bf66-c5e7-4da8-b1e5-fb1ad9991685 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1215 microversion: 2.1 time: 0.130687 Jun 16 21:16:13.872053 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 259/502] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:13 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1215 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:13.958928 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4b3edc2a-66a6-4d0b-8a5d-3a032016098e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:13.959586 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4b3edc2a-66a6-4d0b-8a5d-3a032016098e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:13.966721 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4b3edc2a-66a6-4d0b-8a5d-3a032016098e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:13.967328 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4b3edc2a-66a6-4d0b-8a5d-3a032016098e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:13.968383 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4b3edc2a-66a6-4d0b-8a5d-3a032016098e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:13.968819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4b3edc2a-66a6-4d0b-8a5d-3a032016098e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:14.111920 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4b3edc2a-66a6-4d0b-8a5d-3a032016098e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:14.122103 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4b3edc2a-66a6-4d0b-8a5d-3a032016098e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.167293 Jun 16 21:16:14.122682 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 244/503] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:13 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:14.167022 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-06b02ffa-e5e9-4c0f-b0bd-519e658030af tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:14.167663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-06b02ffa-e5e9-4c0f-b0bd-519e658030af tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:14.169577 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:14.175270 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-06b02ffa-e5e9-4c0f-b0bd-519e658030af tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:14.175708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-06b02ffa-e5e9-4c0f-b0bd-519e658030af tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:14.176573 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-06b02ffa-e5e9-4c0f-b0bd-519e658030af tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:14.177007 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-06b02ffa-e5e9-4c0f-b0bd-519e658030af tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:14.337171 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-06b02ffa-e5e9-4c0f-b0bd-519e658030af tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:14.346346 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-06b02ffa-e5e9-4c0f-b0bd-519e658030af tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:14.348009 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-06b02ffa-e5e9-4c0f-b0bd-519e658030af tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:14.349465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-06b02ffa-e5e9-4c0f-b0bd-519e658030af tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.186687 Jun 16 21:16:14.350018 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 260/504] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:14 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:14.498767 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-fb82b335-b10c-4899-a82b-0df018f6d663 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90c50714-d19e-46e9-8a36-0cb86d68845e"}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:14.499845 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-fb82b335-b10c-4899-a82b-0df018f6d663 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:14.505806 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-fb82b335-b10c-4899-a82b-0df018f6d663 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:14.506245 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-fb82b335-b10c-4899-a82b-0df018f6d663 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:14.506999 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-fb82b335-b10c-4899-a82b-0df018f6d663 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:14.507763 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-fb82b335-b10c-4899-a82b-0df018f6d663 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:14.843874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-998317ab-50d5-4632-9e44-f6778d99021b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:14.844645 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-998317ab-50d5-4632-9e44-f6778d99021b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:14.852698 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-998317ab-50d5-4632-9e44-f6778d99021b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:14.858316 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-998317ab-50d5-4632-9e44-f6778d99021b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:14.858316 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-998317ab-50d5-4632-9e44-f6778d99021b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:14.858316 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-998317ab-50d5-4632-9e44-f6778d99021b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:14.994408 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-998317ab-50d5-4632-9e44-f6778d99021b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:15.001766 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-998317ab-50d5-4632-9e44-f6778d99021b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.161751 Jun 16 21:16:15.002327 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 261/505] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:14 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:15.006693 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-526e1cbc-b819-4630-9acc-ade028b7cd5e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:15.008132 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-526e1cbc-b819-4630-9acc-ade028b7cd5e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:15.013849 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-526e1cbc-b819-4630-9acc-ade028b7cd5e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:15.014289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-526e1cbc-b819-4630-9acc-ade028b7cd5e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:15.015047 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-526e1cbc-b819-4630-9acc-ade028b7cd5e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:15.015477 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-526e1cbc-b819-4630-9acc-ade028b7cd5e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:15.082124 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-526e1cbc-b819-4630-9acc-ade028b7cd5e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:15.090179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-526e1cbc-b819-4630-9acc-ade028b7cd5e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1215 microversion: 2.1 time: 0.086800 Jun 16 21:16:15.090759 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 262/506] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:15 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:15.140599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1a492976-d017-4e07-bb67-8590b49d97f9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:15.141124 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1a492976-d017-4e07-bb67-8590b49d97f9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:15.147134 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1a492976-d017-4e07-bb67-8590b49d97f9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:15.148009 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1a492976-d017-4e07-bb67-8590b49d97f9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:15.148801 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1a492976-d017-4e07-bb67-8590b49d97f9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:15.149239 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1a492976-d017-4e07-bb67-8590b49d97f9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:15.302382 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1a492976-d017-4e07-bb67-8590b49d97f9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:15.310871 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1a492976-d017-4e07-bb67-8590b49d97f9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.174374 Jun 16 21:16:15.311426 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 263/507] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:15 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:15.369173 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-3276eb4c-ee35-471c-8e6c-804cddc19985 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:15.369785 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-3276eb4c-ee35-471c-8e6c-804cddc19985 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:15.375896 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3276eb4c-ee35-471c-8e6c-804cddc19985 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:15.376375 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3276eb4c-ee35-471c-8e6c-804cddc19985 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:15.377144 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3276eb4c-ee35-471c-8e6c-804cddc19985 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:15.377584 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3276eb4c-ee35-471c-8e6c-804cddc19985 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:15.512056 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3276eb4c-ee35-471c-8e6c-804cddc19985 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:15.524443 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3276eb4c-ee35-471c-8e6c-804cddc19985 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:15.525948 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3276eb4c-ee35-471c-8e6c-804cddc19985 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:15.527104 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-3276eb4c-ee35-471c-8e6c-804cddc19985 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.162422 Jun 16 21:16:15.527649 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 264/508] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:15 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:16.021754 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b97c591a-e989-44bf-8731-c22fdd58d779 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:16.022604 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b97c591a-e989-44bf-8731-c22fdd58d779 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:16.030701 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b97c591a-e989-44bf-8731-c22fdd58d779 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:16.031244 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b97c591a-e989-44bf-8731-c22fdd58d779 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:16.032025 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b97c591a-e989-44bf-8731-c22fdd58d779 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:16.032493 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b97c591a-e989-44bf-8731-c22fdd58d779 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:16.181979 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b97c591a-e989-44bf-8731-c22fdd58d779 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:16.190117 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b97c591a-e989-44bf-8731-c22fdd58d779 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.173907 Jun 16 21:16:16.195862 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 265/509] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:16 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:16.199431 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1488483d-ee00-40b2-91e3-d865c9e8391b tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:16.200051 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1488483d-ee00-40b2-91e3-d865c9e8391b tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:16.206267 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1488483d-ee00-40b2-91e3-d865c9e8391b tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:16.206712 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1488483d-ee00-40b2-91e3-d865c9e8391b tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:16.207481 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1488483d-ee00-40b2-91e3-d865c9e8391b tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:16.207918 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1488483d-ee00-40b2-91e3-d865c9e8391b tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:16.273422 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1488483d-ee00-40b2-91e3-d865c9e8391b tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:16.282853 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1488483d-ee00-40b2-91e3-d865c9e8391b tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1215 microversion: 2.1 time: 0.090775 Jun 16 21:16:16.283434 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 266/510] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:16 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:16.328533 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9517571d-933d-4526-bfe2-ebe91af9a9c7 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:16.329144 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-9517571d-933d-4526-bfe2-ebe91af9a9c7 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:16.335648 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9517571d-933d-4526-bfe2-ebe91af9a9c7 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:16.336085 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9517571d-933d-4526-bfe2-ebe91af9a9c7 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:16.336868 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9517571d-933d-4526-bfe2-ebe91af9a9c7 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:16.337303 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9517571d-933d-4526-bfe2-ebe91af9a9c7 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:16.479291 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9517571d-933d-4526-bfe2-ebe91af9a9c7 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:16.487621 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9517571d-933d-4526-bfe2-ebe91af9a9c7 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.162813 Jun 16 21:16:16.488456 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 267/511] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:16 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:16.545290 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c125593d-07fa-45c2-b978-e0bd272ae870 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:16.545989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c125593d-07fa-45c2-b978-e0bd272ae870 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:16.553333 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c125593d-07fa-45c2-b978-e0bd272ae870 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:16.554006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c125593d-07fa-45c2-b978-e0bd272ae870 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:16.554937 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c125593d-07fa-45c2-b978-e0bd272ae870 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:16.555478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c125593d-07fa-45c2-b978-e0bd272ae870 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:16.710718 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c125593d-07fa-45c2-b978-e0bd272ae870 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:16.720090 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c125593d-07fa-45c2-b978-e0bd272ae870 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:16.721602 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c125593d-07fa-45c2-b978-e0bd272ae870 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:16.722762 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c125593d-07fa-45c2-b978-e0bd272ae870 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.181301 Jun 16 21:16:16.723392 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 268/512] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:16 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:16:17.206860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f0bfef33-6fce-4e7f-8128-030788fa2521 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:17.207548 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f0bfef33-6fce-4e7f-8128-030788fa2521 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:17.215243 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f0bfef33-6fce-4e7f-8128-030788fa2521 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:17.215912 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f0bfef33-6fce-4e7f-8128-030788fa2521 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:17.216613 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f0bfef33-6fce-4e7f-8128-030788fa2521 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:17.217157 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f0bfef33-6fce-4e7f-8128-030788fa2521 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:17.389527 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f0bfef33-6fce-4e7f-8128-030788fa2521 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:17.397020 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f0bfef33-6fce-4e7f-8128-030788fa2521 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.194110 Jun 16 21:16:17.398278 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 269/513] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:17 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:17.403381 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-89a99a71-db26-445c-8a65-b6fb94f943b0 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:17.404004 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-89a99a71-db26-445c-8a65-b6fb94f943b0 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:17.410164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-89a99a71-db26-445c-8a65-b6fb94f943b0 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:17.410603 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-89a99a71-db26-445c-8a65-b6fb94f943b0 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:17.411573 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-89a99a71-db26-445c-8a65-b6fb94f943b0 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:17.412053 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-89a99a71-db26-445c-8a65-b6fb94f943b0 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:17.478240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-89a99a71-db26-445c-8a65-b6fb94f943b0 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:17.486453 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-89a99a71-db26-445c-8a65-b6fb94f943b0 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1215 microversion: 2.1 time: 0.086840 Jun 16 21:16:17.487285 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 270/514] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:17 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:17.505091 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d0cbbfb4-90d7-4fa5-9162-c985f5921719 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:17.505711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d0cbbfb4-90d7-4fa5-9162-c985f5921719 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:17.513364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d0cbbfb4-90d7-4fa5-9162-c985f5921719 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:17.513810 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d0cbbfb4-90d7-4fa5-9162-c985f5921719 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:17.514598 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d0cbbfb4-90d7-4fa5-9162-c985f5921719 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:17.515030 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d0cbbfb4-90d7-4fa5-9162-c985f5921719 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:17.662431 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d0cbbfb4-90d7-4fa5-9162-c985f5921719 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:17.671915 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d0cbbfb4-90d7-4fa5-9162-c985f5921719 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.170301 Jun 16 21:16:17.672544 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 271/515] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:17 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:17.742408 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-fe6420f1-4fe8-4245-b3ac-b6af37343bbb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:17.742941 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-fe6420f1-4fe8-4245-b3ac-b6af37343bbb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:17.749062 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fe6420f1-4fe8-4245-b3ac-b6af37343bbb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:17.749513 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fe6420f1-4fe8-4245-b3ac-b6af37343bbb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:17.750280 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fe6420f1-4fe8-4245-b3ac-b6af37343bbb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:17.750714 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fe6420f1-4fe8-4245-b3ac-b6af37343bbb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:17.755637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=100 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:17.898872 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-fe6420f1-4fe8-4245-b3ac-b6af37343bbb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:17.917201 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-fe6420f1-4fe8-4245-b3ac-b6af37343bbb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:17.918861 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-fe6420f1-4fe8-4245-b3ac-b6af37343bbb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:17.920063 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-fe6420f1-4fe8-4245-b3ac-b6af37343bbb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.182573 Jun 16 21:16:17.920643 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 272/516] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:17 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:18.417869 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-759aa099-f623-4ce5-ba85-4850bf91d945 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:18.418560 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-759aa099-f623-4ce5-ba85-4850bf91d945 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:18.425386 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-759aa099-f623-4ce5-ba85-4850bf91d945 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:18.425837 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-759aa099-f623-4ce5-ba85-4850bf91d945 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:18.426613 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-759aa099-f623-4ce5-ba85-4850bf91d945 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:18.427050 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-759aa099-f623-4ce5-ba85-4850bf91d945 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:18.568688 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-759aa099-f623-4ce5-ba85-4850bf91d945 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:18.577797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-759aa099-f623-4ce5-ba85-4850bf91d945 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.164388 Jun 16 21:16:18.578382 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 273/517] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:18 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:18.582871 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-bbd0e50f-f50a-4c96-82a6-11b42fbb91b5 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:18.583485 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-bbd0e50f-f50a-4c96-82a6-11b42fbb91b5 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:18.589891 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bbd0e50f-f50a-4c96-82a6-11b42fbb91b5 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:18.590343 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bbd0e50f-f50a-4c96-82a6-11b42fbb91b5 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:18.592882 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bbd0e50f-f50a-4c96-82a6-11b42fbb91b5 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:18.593552 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bbd0e50f-f50a-4c96-82a6-11b42fbb91b5 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:18.660884 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bbd0e50f-f50a-4c96-82a6-11b42fbb91b5 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:18.668540 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-bbd0e50f-f50a-4c96-82a6-11b42fbb91b5 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1215 microversion: 2.1 time: 0.089116 Jun 16 21:16:18.669250 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 274/518] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:18 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:18.690408 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ed28ede2-4ec4-4282-844e-b6f401ff2da3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:18.691018 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ed28ede2-4ec4-4282-844e-b6f401ff2da3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:18.698458 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ed28ede2-4ec4-4282-844e-b6f401ff2da3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:18.698902 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ed28ede2-4ec4-4282-844e-b6f401ff2da3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:18.699672 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ed28ede2-4ec4-4282-844e-b6f401ff2da3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:18.700101 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ed28ede2-4ec4-4282-844e-b6f401ff2da3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:18.846245 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-ed28ede2-4ec4-4282-844e-b6f401ff2da3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:18.854584 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ed28ede2-4ec4-4282-844e-b6f401ff2da3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.167987 Jun 16 21:16:18.855334 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 275/519] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:18 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:18.939253 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5889eccd-2c02-42d1-849f-79ee2c3bb0f4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:18.939784 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5889eccd-2c02-42d1-849f-79ee2c3bb0f4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:18.946641 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5889eccd-2c02-42d1-849f-79ee2c3bb0f4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:18.947097 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5889eccd-2c02-42d1-849f-79ee2c3bb0f4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:18.947946 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5889eccd-2c02-42d1-849f-79ee2c3bb0f4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:18.948480 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5889eccd-2c02-42d1-849f-79ee2c3bb0f4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:19.082300 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5889eccd-2c02-42d1-849f-79ee2c3bb0f4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:19.092929 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5889eccd-2c02-42d1-849f-79ee2c3bb0f4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:19.094648 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5889eccd-2c02-42d1-849f-79ee2c3bb0f4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:19.096084 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5889eccd-2c02-42d1-849f-79ee2c3bb0f4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.160913 Jun 16 21:16:19.096776 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 276/520] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:18 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:16:19.595220 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4071e8d9-de9a-40b5-805c-214a6385cd2e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:19.595980 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4071e8d9-de9a-40b5-805c-214a6385cd2e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:19.603608 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4071e8d9-de9a-40b5-805c-214a6385cd2e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:19.604056 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4071e8d9-de9a-40b5-805c-214a6385cd2e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:19.605558 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4071e8d9-de9a-40b5-805c-214a6385cd2e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:19.605987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4071e8d9-de9a-40b5-805c-214a6385cd2e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:19.753467 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4071e8d9-de9a-40b5-805c-214a6385cd2e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:19.762247 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4071e8d9-de9a-40b5-805c-214a6385cd2e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.171061 Jun 16 21:16:19.762825 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 277/521] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:19 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:19.767520 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d159a6d5-404a-43b0-9ab8-2043a05e1c84 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:19.768121 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d159a6d5-404a-43b0-9ab8-2043a05e1c84 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:19.776130 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d159a6d5-404a-43b0-9ab8-2043a05e1c84 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:19.776605 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d159a6d5-404a-43b0-9ab8-2043a05e1c84 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:19.777372 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d159a6d5-404a-43b0-9ab8-2043a05e1c84 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:19.777804 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d159a6d5-404a-43b0-9ab8-2043a05e1c84 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:19.840866 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d159a6d5-404a-43b0-9ab8-2043a05e1c84 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:19.849553 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d159a6d5-404a-43b0-9ab8-2043a05e1c84 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1215 microversion: 2.1 time: 0.085570 Jun 16 21:16:19.852284 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 278/522] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:19 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:19.873445 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-56c2b096-98bd-4d42-8578-687aa488921c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:19.874054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-56c2b096-98bd-4d42-8578-687aa488921c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:19.880271 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-56c2b096-98bd-4d42-8578-687aa488921c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:19.880699 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-56c2b096-98bd-4d42-8578-687aa488921c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:19.881486 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-56c2b096-98bd-4d42-8578-687aa488921c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:19.883407 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-56c2b096-98bd-4d42-8578-687aa488921c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:20.033011 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-56c2b096-98bd-4d42-8578-687aa488921c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:20.041315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-56c2b096-98bd-4d42-8578-687aa488921c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.171728 Jun 16 21:16:20.041891 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 279/523] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:19 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:20.115006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-614cf315-9b86-4858-af87-1d1f78ed8acf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:20.115527 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-614cf315-9b86-4858-af87-1d1f78ed8acf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:20.121692 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-614cf315-9b86-4858-af87-1d1f78ed8acf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:20.122131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-614cf315-9b86-4858-af87-1d1f78ed8acf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:20.122888 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-614cf315-9b86-4858-af87-1d1f78ed8acf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:20.123307 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-614cf315-9b86-4858-af87-1d1f78ed8acf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:20.268419 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-614cf315-9b86-4858-af87-1d1f78ed8acf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:20.276870 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-614cf315-9b86-4858-af87-1d1f78ed8acf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:20.278346 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-614cf315-9b86-4858-af87-1d1f78ed8acf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:20.279493 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-614cf315-9b86-4858-af87-1d1f78ed8acf tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.168665 Jun 16 21:16:20.280041 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 280/524] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:20 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:16:20.778827 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-cff997db-d74b-41a0-8808-f568a2750014 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:20.779806 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-cff997db-d74b-41a0-8808-f568a2750014 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:20.786023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cff997db-d74b-41a0-8808-f568a2750014 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:20.786469 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cff997db-d74b-41a0-8808-f568a2750014 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:20.787237 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cff997db-d74b-41a0-8808-f568a2750014 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:20.787668 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cff997db-d74b-41a0-8808-f568a2750014 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:20.928371 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-cff997db-d74b-41a0-8808-f568a2750014 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:20.936937 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-cff997db-d74b-41a0-8808-f568a2750014 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.161896 Jun 16 21:16:20.937513 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 281/525] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:20 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:20.947344 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-6aa5d235-1f56-43df-a3d0-3cd1e3643289 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:20.947344 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-6aa5d235-1f56-43df-a3d0-3cd1e3643289 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:20.951019 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6aa5d235-1f56-43df-a3d0-3cd1e3643289 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:20.951468 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6aa5d235-1f56-43df-a3d0-3cd1e3643289 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:20.952544 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6aa5d235-1f56-43df-a3d0-3cd1e3643289 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:20.952980 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6aa5d235-1f56-43df-a3d0-3cd1e3643289 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:21.022102 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6aa5d235-1f56-43df-a3d0-3cd1e3643289 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:21.029942 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-6aa5d235-1f56-43df-a3d0-3cd1e3643289 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1215 microversion: 2.1 time: 0.091418 Jun 16 21:16:21.034640 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 282/526] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:20 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:21.058412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d50b6dfd-b762-4871-9a94-df37db6d04d0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:21.059023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d50b6dfd-b762-4871-9a94-df37db6d04d0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:21.065266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d50b6dfd-b762-4871-9a94-df37db6d04d0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:21.065710 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d50b6dfd-b762-4871-9a94-df37db6d04d0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:21.066467 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d50b6dfd-b762-4871-9a94-df37db6d04d0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:21.066897 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d50b6dfd-b762-4871-9a94-df37db6d04d0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:21.217237 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d50b6dfd-b762-4871-9a94-df37db6d04d0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:21.226376 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d50b6dfd-b762-4871-9a94-df37db6d04d0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.171929 Jun 16 21:16:21.228091 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 283/527] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:21 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:21.299933 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8babe534-811d-4670-8433-b17df4d95c08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:21.300680 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8babe534-811d-4670-8433-b17df4d95c08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:21.310471 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8babe534-811d-4670-8433-b17df4d95c08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:21.311206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8babe534-811d-4670-8433-b17df4d95c08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:21.312498 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8babe534-811d-4670-8433-b17df4d95c08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:21.313220 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8babe534-811d-4670-8433-b17df4d95c08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:21.462292 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8babe534-811d-4670-8433-b17df4d95c08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:21.470596 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8babe534-811d-4670-8433-b17df4d95c08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:21.472081 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8babe534-811d-4670-8433-b17df4d95c08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:21.473271 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8babe534-811d-4670-8433-b17df4d95c08 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.178265 Jun 16 21:16:21.473833 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 284/528] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:21 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:16:21.955296 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-dd362868-25b9-4f06-bc44-418bda07c557 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:21.956087 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-dd362868-25b9-4f06-bc44-418bda07c557 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:21.965179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dd362868-25b9-4f06-bc44-418bda07c557 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:21.965627 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dd362868-25b9-4f06-bc44-418bda07c557 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:21.966568 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dd362868-25b9-4f06-bc44-418bda07c557 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:21.967010 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dd362868-25b9-4f06-bc44-418bda07c557 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:22.118395 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-dd362868-25b9-4f06-bc44-418bda07c557 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:22.126337 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-dd362868-25b9-4f06-bc44-418bda07c557 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.174864 Jun 16 21:16:22.127273 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 285/529] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:21 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:22.139617 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e7dab9a3-aa9d-4f11-b88d-f0f277bcf06c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:22.140246 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e7dab9a3-aa9d-4f11-b88d-f0f277bcf06c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:22.146795 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e7dab9a3-aa9d-4f11-b88d-f0f277bcf06c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:22.147233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e7dab9a3-aa9d-4f11-b88d-f0f277bcf06c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:22.148332 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e7dab9a3-aa9d-4f11-b88d-f0f277bcf06c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:22.148832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e7dab9a3-aa9d-4f11-b88d-f0f277bcf06c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:22.216376 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e7dab9a3-aa9d-4f11-b88d-f0f277bcf06c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:22.224017 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e7dab9a3-aa9d-4f11-b88d-f0f277bcf06c tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1215 microversion: 2.1 time: 0.095605 Jun 16 21:16:22.224830 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 286/530] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:22 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:22.245846 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-74e7e4be-6d6c-4553-9bc6-49c6641b8293 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:22.246564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-74e7e4be-6d6c-4553-9bc6-49c6641b8293 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:22.253894 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-74e7e4be-6d6c-4553-9bc6-49c6641b8293 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:22.254333 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-74e7e4be-6d6c-4553-9bc6-49c6641b8293 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:22.255100 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-74e7e4be-6d6c-4553-9bc6-49c6641b8293 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:22.255523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-74e7e4be-6d6c-4553-9bc6-49c6641b8293 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:22.301458 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=2 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:22.396350 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-74e7e4be-6d6c-4553-9bc6-49c6641b8293 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:22.406028 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-74e7e4be-6d6c-4553-9bc6-49c6641b8293 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1723 microversion: 2.1 time: 0.164245 Jun 16 21:16:22.406987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 287/531] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:22 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:22.492866 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-26047acd-a7a5-4ccd-b9aa-9f8cd6e9a6d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:22.493481 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-26047acd-a7a5-4ccd-b9aa-9f8cd6e9a6d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:22.499565 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-26047acd-a7a5-4ccd-b9aa-9f8cd6e9a6d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:22.500011 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-26047acd-a7a5-4ccd-b9aa-9f8cd6e9a6d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:22.500800 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-26047acd-a7a5-4ccd-b9aa-9f8cd6e9a6d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:22.501233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-26047acd-a7a5-4ccd-b9aa-9f8cd6e9a6d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:22.535100 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:22.559341 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=6 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:22.637183 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-26047acd-a7a5-4ccd-b9aa-9f8cd6e9a6d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:22.640565 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=100 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:22.646502 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-26047acd-a7a5-4ccd-b9aa-9f8cd6e9a6d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:22.647957 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-26047acd-a7a5-4ccd-b9aa-9f8cd6e9a6d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:22.649148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-26047acd-a7a5-4ccd-b9aa-9f8cd6e9a6d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.161117 Jun 16 21:16:22.649737 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 288/532] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:22 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:16:22.725385 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=2 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:23.145076 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0007bdb6-d47e-49d3-b081-69c3ba6e6606 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:23.145686 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0007bdb6-d47e-49d3-b081-69c3ba6e6606 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:23.152579 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0007bdb6-d47e-49d3-b081-69c3ba6e6606 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:23.153023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0007bdb6-d47e-49d3-b081-69c3ba6e6606 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:23.153774 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0007bdb6-d47e-49d3-b081-69c3ba6e6606 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:23.154207 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0007bdb6-d47e-49d3-b081-69c3ba6e6606 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:23.287168 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0007bdb6-d47e-49d3-b081-69c3ba6e6606 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:23.295952 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0007bdb6-d47e-49d3-b081-69c3ba6e6606 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.154900 Jun 16 21:16:23.296555 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 289/533] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:23 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:23.300954 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b956b63d-9554-4979-80c4-084f33185eef tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:23.301551 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b956b63d-9554-4979-80c4-084f33185eef tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:23.307895 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b956b63d-9554-4979-80c4-084f33185eef tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:23.308359 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b956b63d-9554-4979-80c4-084f33185eef tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:23.309115 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b956b63d-9554-4979-80c4-084f33185eef tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:23.309536 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b956b63d-9554-4979-80c4-084f33185eef tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:23.375787 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b956b63d-9554-4979-80c4-084f33185eef tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:23.383918 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b956b63d-9554-4979-80c4-084f33185eef tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1215 microversion: 2.1 time: 0.086302 Jun 16 21:16:23.384664 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 290/534] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:23 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:23.424035 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-49bdecbd-17c6-46a9-85ff-9e1aa3561717 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:23.425264 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-49bdecbd-17c6-46a9-85ff-9e1aa3561717 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:23.434177 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-49bdecbd-17c6-46a9-85ff-9e1aa3561717 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:23.435024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-49bdecbd-17c6-46a9-85ff-9e1aa3561717 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:23.436196 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-49bdecbd-17c6-46a9-85ff-9e1aa3561717 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:23.436574 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-49bdecbd-17c6-46a9-85ff-9e1aa3561717 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:23.580150 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-49bdecbd-17c6-46a9-85ff-9e1aa3561717 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:23.588632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-49bdecbd-17c6-46a9-85ff-9e1aa3561717 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1700 microversion: 2.1 time: 0.169204 Jun 16 21:16:23.589214 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 291/535] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:23 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1700 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:23.605517 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-3fcc9628-580f-4ae5-9bdb-f9ccb9eb654e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:23.611512 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3fcc9628-580f-4ae5-9bdb-f9ccb9eb654e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:23.612083 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3fcc9628-580f-4ae5-9bdb-f9ccb9eb654e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:23.642911 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-3fcc9628-580f-4ae5-9bdb-f9ccb9eb654e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Going to try to start instance {{(pid=117737) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 21:16:23.691086 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-3fcc9628-580f-4ae5-9bdb-f9ccb9eb654e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "POST /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/action" status: 202 len: 0 microversion: 2.1 time: 0.089879 Jun 16 21:16:23.691622 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 292/536] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 16 21:16:23 2022] POST /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 21:16:23.696828 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-30b44089-393b-479c-8360-062107c64b0a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:23.697522 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-30b44089-393b-479c-8360-062107c64b0a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:23.703636 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-30b44089-393b-479c-8360-062107c64b0a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:23.704155 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-30b44089-393b-479c-8360-062107c64b0a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:23.705018 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-30b44089-393b-479c-8360-062107c64b0a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:23.705556 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-30b44089-393b-479c-8360-062107c64b0a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:23.774638 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-fb82b335-b10c-4899-a82b-0df018f6d663 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "POST /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.279651 Jun 16 21:16:23.775565 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 245/537] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 16 21:16:14 2022] POST /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/os-volume_attachments => generated 194 bytes in 9281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:16:23.780847 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9e6d00f2-c934-477c-96f2-52426f5855f9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:23.781546 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-9e6d00f2-c934-477c-96f2-52426f5855f9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:23.788643 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9e6d00f2-c934-477c-96f2-52426f5855f9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:23.789449 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9e6d00f2-c934-477c-96f2-52426f5855f9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:23.790309 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9e6d00f2-c934-477c-96f2-52426f5855f9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:23.790738 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9e6d00f2-c934-477c-96f2-52426f5855f9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:23.847944 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-30b44089-393b-479c-8360-062107c64b0a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:23.857147 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-30b44089-393b-479c-8360-062107c64b0a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:23.858644 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-30b44089-393b-479c-8360-062107c64b0a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:23.859815 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-30b44089-393b-479c-8360-062107c64b0a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.167086 Jun 16 21:16:23.860396 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 293/538] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:23 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:23.927933 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9e6d00f2-c934-477c-96f2-52426f5855f9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:23.936720 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-9e6d00f2-c934-477c-96f2-52426f5855f9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1709 microversion: 2.1 time: 0.160017 Jun 16 21:16:23.937280 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 246/539] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:23 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:24.314773 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-31947810-e883-49d1-9136-10a0fdd264df tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:24.315384 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-31947810-e883-49d1-9136-10a0fdd264df tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:24.322124 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-31947810-e883-49d1-9136-10a0fdd264df tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:24.322571 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-31947810-e883-49d1-9136-10a0fdd264df tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:24.323326 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-31947810-e883-49d1-9136-10a0fdd264df tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:24.323754 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-31947810-e883-49d1-9136-10a0fdd264df tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:24.402482 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d268036e-9165-40cf-9f83-3abb9f121050 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:24.403184 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d268036e-9165-40cf-9f83-3abb9f121050 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:24.411266 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d268036e-9165-40cf-9f83-3abb9f121050 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:24.411796 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d268036e-9165-40cf-9f83-3abb9f121050 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:24.412640 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d268036e-9165-40cf-9f83-3abb9f121050 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:24.413073 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d268036e-9165-40cf-9f83-3abb9f121050 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:24.462524 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-31947810-e883-49d1-9136-10a0fdd264df tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:24.470271 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-31947810-e883-49d1-9136-10a0fdd264df tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.159362 Jun 16 21:16:24.471029 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 294/540] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:24 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:24.477797 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d268036e-9165-40cf-9f83-3abb9f121050 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:24.485671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d268036e-9165-40cf-9f83-3abb9f121050 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1271 microversion: 2.1 time: 0.088212 Jun 16 21:16:24.486247 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 247/541] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:24 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:24.878836 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1a7e41df-04f1-46ae-b494-0f674d6a7ade tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:24.879438 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1a7e41df-04f1-46ae-b494-0f674d6a7ade tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:24.886173 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1a7e41df-04f1-46ae-b494-0f674d6a7ade tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:24.886676 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1a7e41df-04f1-46ae-b494-0f674d6a7ade tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:24.887428 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1a7e41df-04f1-46ae-b494-0f674d6a7ade tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:24.887880 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1a7e41df-04f1-46ae-b494-0f674d6a7ade tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:24.955485 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-94de266a-6df4-4fe4-b74f-1eb6fe0c7e93 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:24.956277 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-94de266a-6df4-4fe4-b74f-1eb6fe0c7e93 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:24.964152 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-94de266a-6df4-4fe4-b74f-1eb6fe0c7e93 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:24.964885 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-94de266a-6df4-4fe4-b74f-1eb6fe0c7e93 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:24.965685 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-94de266a-6df4-4fe4-b74f-1eb6fe0c7e93 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:24.966120 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-94de266a-6df4-4fe4-b74f-1eb6fe0c7e93 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:25.030545 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1a7e41df-04f1-46ae-b494-0f674d6a7ade tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:25.039357 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1a7e41df-04f1-46ae-b494-0f674d6a7ade tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:25.040935 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1a7e41df-04f1-46ae-b494-0f674d6a7ade tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:25.042106 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1a7e41df-04f1-46ae-b494-0f674d6a7ade tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.167236 Jun 16 21:16:25.042659 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 295/542] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:24 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:25.098733 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-94de266a-6df4-4fe4-b74f-1eb6fe0c7e93 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:25.106680 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-94de266a-6df4-4fe4-b74f-1eb6fe0c7e93 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1709 microversion: 2.1 time: 0.155641 Jun 16 21:16:25.107241 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 248/543] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:24 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1709 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:25.488757 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e3c3ecda-320d-4266-8e7b-78eae41028d0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:25.489299 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e3c3ecda-320d-4266-8e7b-78eae41028d0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:25.496949 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e3c3ecda-320d-4266-8e7b-78eae41028d0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:25.497390 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e3c3ecda-320d-4266-8e7b-78eae41028d0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:25.498152 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e3c3ecda-320d-4266-8e7b-78eae41028d0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:25.498581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e3c3ecda-320d-4266-8e7b-78eae41028d0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:25.502781 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2e02e7b7-93f8-4db4-8560-d9694e74fc83 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:25.503482 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2e02e7b7-93f8-4db4-8560-d9694e74fc83 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:25.509416 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e02e7b7-93f8-4db4-8560-d9694e74fc83 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:25.509857 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e02e7b7-93f8-4db4-8560-d9694e74fc83 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:25.510622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e02e7b7-93f8-4db4-8560-d9694e74fc83 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:25.511029 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e02e7b7-93f8-4db4-8560-d9694e74fc83 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:25.572744 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2e02e7b7-93f8-4db4-8560-d9694e74fc83 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:25.579949 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2e02e7b7-93f8-4db4-8560-d9694e74fc83 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1289 microversion: 2.1 time: 0.081028 Jun 16 21:16:25.580539 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 249/544] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:25 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1289 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:25.629637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e3c3ecda-320d-4266-8e7b-78eae41028d0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:25.637169 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e3c3ecda-320d-4266-8e7b-78eae41028d0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.152622 Jun 16 21:16:25.637727 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 296/545] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:25 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:26.061522 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-72b96ba5-7bd4-4e39-9774-7a5cbfcc01ea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:26.062814 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-72b96ba5-7bd4-4e39-9774-7a5cbfcc01ea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:26.069988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-72b96ba5-7bd4-4e39-9774-7a5cbfcc01ea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:26.071207 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-72b96ba5-7bd4-4e39-9774-7a5cbfcc01ea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:26.072360 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-72b96ba5-7bd4-4e39-9774-7a5cbfcc01ea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:26.073002 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-72b96ba5-7bd4-4e39-9774-7a5cbfcc01ea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:26.124796 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1a76643a-db82-47d6-9589-49c756f8c1bf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:26.125434 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1a76643a-db82-47d6-9589-49c756f8c1bf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:26.133152 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1a76643a-db82-47d6-9589-49c756f8c1bf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:26.133634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1a76643a-db82-47d6-9589-49c756f8c1bf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:26.134529 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1a76643a-db82-47d6-9589-49c756f8c1bf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:26.134963 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1a76643a-db82-47d6-9589-49c756f8c1bf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:26.229411 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-72b96ba5-7bd4-4e39-9774-7a5cbfcc01ea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:26.237938 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-72b96ba5-7bd4-4e39-9774-7a5cbfcc01ea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:26.239873 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-72b96ba5-7bd4-4e39-9774-7a5cbfcc01ea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:26.241140 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-72b96ba5-7bd4-4e39-9774-7a5cbfcc01ea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.184506 Jun 16 21:16:26.241781 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 250/546] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:26 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:26.366254 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1a76643a-db82-47d6-9589-49c756f8c1bf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:26.374966 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1a76643a-db82-47d6-9589-49c756f8c1bf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1709 microversion: 2.1 time: 0.254601 Jun 16 21:16:26.375539 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 297/547] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:26 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1709 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:26.598057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-100ed6ab-93f0-465b-b63d-b8ad073b50ee tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:26.598741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-100ed6ab-93f0-465b-b63d-b8ad073b50ee tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:26.606740 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-100ed6ab-93f0-465b-b63d-b8ad073b50ee tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:26.606740 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-100ed6ab-93f0-465b-b63d-b8ad073b50ee tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:26.607283 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-100ed6ab-93f0-465b-b63d-b8ad073b50ee tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:26.607696 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-100ed6ab-93f0-465b-b63d-b8ad073b50ee tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:26.656125 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-48dd263e-60bd-48a6-9de8-a931d70b6ff4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:26.656752 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-48dd263e-60bd-48a6-9de8-a931d70b6ff4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:26.665355 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-48dd263e-60bd-48a6-9de8-a931d70b6ff4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:26.665797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-48dd263e-60bd-48a6-9de8-a931d70b6ff4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:26.666614 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-48dd263e-60bd-48a6-9de8-a931d70b6ff4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:26.667041 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-48dd263e-60bd-48a6-9de8-a931d70b6ff4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:26.747857 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-100ed6ab-93f0-465b-b63d-b8ad073b50ee tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:26.758415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-100ed6ab-93f0-465b-b63d-b8ad073b50ee tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1319 microversion: 2.1 time: 0.163818 Jun 16 21:16:26.759095 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 251/548] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:26 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:26.853681 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-48dd263e-60bd-48a6-9de8-a931d70b6ff4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:26.861474 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-48dd263e-60bd-48a6-9de8-a931d70b6ff4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.210340 Jun 16 21:16:26.862058 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 298/549] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:26 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:27.260800 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-306fce86-5e67-4f7b-8146-724fff040bfc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:27.261342 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-306fce86-5e67-4f7b-8146-724fff040bfc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:27.267410 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-306fce86-5e67-4f7b-8146-724fff040bfc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:27.267849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-306fce86-5e67-4f7b-8146-724fff040bfc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:27.268636 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-306fce86-5e67-4f7b-8146-724fff040bfc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:27.269062 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-306fce86-5e67-4f7b-8146-724fff040bfc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:27.392512 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-fea5cf2d-09b6-4f5b-b5b4-c55eb0e39a3a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:27.393409 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-fea5cf2d-09b6-4f5b-b5b4-c55eb0e39a3a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:27.401338 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fea5cf2d-09b6-4f5b-b5b4-c55eb0e39a3a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:27.402228 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fea5cf2d-09b6-4f5b-b5b4-c55eb0e39a3a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:27.403193 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fea5cf2d-09b6-4f5b-b5b4-c55eb0e39a3a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:27.404087 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fea5cf2d-09b6-4f5b-b5b4-c55eb0e39a3a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:27.413459 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-306fce86-5e67-4f7b-8146-724fff040bfc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:27.423355 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-306fce86-5e67-4f7b-8146-724fff040bfc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:27.424867 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-306fce86-5e67-4f7b-8146-724fff040bfc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:27.426051 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-306fce86-5e67-4f7b-8146-724fff040bfc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.169865 Jun 16 21:16:27.426638 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 252/550] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:27 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:27.690868 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-fea5cf2d-09b6-4f5b-b5b4-c55eb0e39a3a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:27.699445 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-fea5cf2d-09b6-4f5b-b5b4-c55eb0e39a3a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1709 microversion: 2.1 time: 0.310875 Jun 16 21:16:27.699957 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 299/551] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:27 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1709 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:27.775797 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c5edcd53-f6b5-43e5-8cb8-6e1dd1f2eb38 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:27.776611 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c5edcd53-f6b5-43e5-8cb8-6e1dd1f2eb38 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:27.782828 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c5edcd53-f6b5-43e5-8cb8-6e1dd1f2eb38 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:27.783357 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c5edcd53-f6b5-43e5-8cb8-6e1dd1f2eb38 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:27.784212 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c5edcd53-f6b5-43e5-8cb8-6e1dd1f2eb38 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:27.785190 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c5edcd53-f6b5-43e5-8cb8-6e1dd1f2eb38 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:27.879712 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4b5dbfa9-8289-45be-b3d4-fe74dea9fafc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:27.880401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4b5dbfa9-8289-45be-b3d4-fe74dea9fafc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:27.887417 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b5dbfa9-8289-45be-b3d4-fe74dea9fafc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:27.887867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b5dbfa9-8289-45be-b3d4-fe74dea9fafc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:27.888665 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b5dbfa9-8289-45be-b3d4-fe74dea9fafc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:27.889096 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b5dbfa9-8289-45be-b3d4-fe74dea9fafc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:27.918037 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c5edcd53-f6b5-43e5-8cb8-6e1dd1f2eb38 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:27.926850 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c5edcd53-f6b5-43e5-8cb8-6e1dd1f2eb38 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1319 microversion: 2.1 time: 0.155500 Jun 16 21:16:27.927632 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 253/552] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:27 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:28.049560 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-d630ff0e-62b1-48d2-978a-d4baba03ebd2 req-60466a79-ead2-4dcf-a76c-749658b2d73a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a0c875b-5859-4684-8846-25255f38cc90", "tag": "0bea97fe-a1f6-4344-b4a0-a56b13b5543c"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:28.058504 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-d630ff0e-62b1-48d2-978a-d4baba03ebd2 req-60466a79-ead2-4dcf-a76c-749658b2d73a service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:28.058949 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-d630ff0e-62b1-48d2-978a-d4baba03ebd2 req-60466a79-ead2-4dcf-a76c-749658b2d73a service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:28.071463 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-d630ff0e-62b1-48d2-978a-d4baba03ebd2 req-60466a79-ead2-4dcf-a76c-749658b2d73a service nova] Creating event network-changed:0bea97fe-a1f6-4344-b4a0-a56b13b5543c for instance 1a0c875b-5859-4684-8846-25255f38cc90 on hv-cinder-81914 Jun 16 21:16:28.076503 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-d630ff0e-62b1-48d2-978a-d4baba03ebd2 req-60466a79-ead2-4dcf-a76c-749658b2d73a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030471 Jun 16 21:16:28.077094 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 254/553] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:16:28.099187 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4b5dbfa9-8289-45be-b3d4-fe74dea9fafc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:28.107205 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4b5dbfa9-8289-45be-b3d4-fe74dea9fafc tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1502 microversion: 2.1 time: 0.231215 Jun 16 21:16:28.107706 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 300/554] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:27 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1502 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:28.125093 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b3f76860-ff66-4fde-a074-b33410a37f78 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b7bda6e-b318-4204-a085-f34ef720dea2"}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:28.126235 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b3f76860-ff66-4fde-a074-b33410a37f78 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:28.133323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b3f76860-ff66-4fde-a074-b33410a37f78 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:28.133787 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b3f76860-ff66-4fde-a074-b33410a37f78 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:28.134504 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b3f76860-ff66-4fde-a074-b33410a37f78 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:28.134937 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b3f76860-ff66-4fde-a074-b33410a37f78 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:28.158396 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-b3f76860-ff66-4fde-a074-b33410a37f78 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] HTTP exception thrown: Cannot 'attach_volume' instance 633275c9-cc8b-4860-b701-2085f7323773 while it is in vm_state rescued Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b3f76860-ff66-4fde-a074-b33410a37f78 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Request method failure captured: Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: POST /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773/os-volume_attachments HTTP/1.1 Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 74 Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq507epJ_aTadF1Dd3rdHpBGlGRf4wX2wIMRrVEIy3GJv1cGUncdSTggT3o9d1eY2ow3SkuABL36GC1u31rXJx0UKPHWR1fNJBZP9pTZGMEU61bDRMu4A9RHCrRkLu91ThMUkD7yCVbJCHJ74gAcATick2BtzDKets9fD-77KD88q3xc Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 6b341c2d77764f3890f2501cfc6945a7 Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-273390268 Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:16:28.160143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:16:28.161817 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b341c2d77764f3890f2501cfc6945a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6b341c2d77764f3890f2501cfc6945a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b341c2d77764f3890f2501cfc6945a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6b341c2d77764f3890f2501cfc6945a7"}]}] Jun 16 21:16:28.161817 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-ServerRescueNegativeTestJSON-273390268 Jun 16 21:16:28.161817 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 6b341c2d77764f3890f2501cfc6945a7 Jun 16 21:16:28.161817 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-273390268 Jun 16 21:16:28.161817 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-ServerRescueNegativeTestJSON-273390268-project Jun 16 21:16:28.161817 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:16:28.161817 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:16:28.161817 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 1d410832e6584828875128e31baa0ae8 Jun 16 21:16:28.161817 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-ServerRescueNegativeTestJSON-273390268-project Jun 16 21:16:28.161817 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Jun 16 21:16:28.161817 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {"volumeAttachment": {"volumeId": "4b7bda6e-b318-4204-a085-f34ef720dea2"}} Jun 16 21:16:28.161817 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Cannot 'attach_volume' instance 633275c9-cc8b-4860-b701-2085f7323773 while it is in vm_state rescued Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'server_id': '633275c9-cc8b-4860-b701-2085f7323773', 'body': {'volumeAttachment': {'volumeId': '4b7bda6e-b318-4204-a085-f34ef720dea2'}}} Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 633275c9-cc8b-4860-b701-2085f7323773 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:16:28.163058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 633275c9-cc8b-4860-b701-2085f7323773 while it is in vm_state rescued Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:16:28.164772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:16:28.166225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:16:28.166225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:16:28.166225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 633275c9-cc8b-4860-b701-2085f7323773 while it is in vm_state rescued Jun 16 21:16:28.166225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:16:28.166225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b3f76860-ff66-4fde-a074-b33410a37f78 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Returning 409 to user: Cannot 'attach_volume' instance 633275c9-cc8b-4860-b701-2085f7323773 while it is in vm_state rescued {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:16:28.166225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b3f76860-ff66-4fde-a074-b33410a37f78 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "POST /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040854 Jun 16 21:16:28.166225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 255/555] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 16 21:16:28 2022] POST /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 21:16:28.170271 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b8d6124e-ec2f-4e8c-9340-944fcef8a49d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:28.170793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b8d6124e-ec2f-4e8c-9340-944fcef8a49d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:28.176988 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b8d6124e-ec2f-4e8c-9340-944fcef8a49d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:28.177426 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b8d6124e-ec2f-4e8c-9340-944fcef8a49d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:28.178171 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b8d6124e-ec2f-4e8c-9340-944fcef8a49d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:28.178594 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b8d6124e-ec2f-4e8c-9340-944fcef8a49d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:28.246027 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b8d6124e-ec2f-4e8c-9340-944fcef8a49d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "POST /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773/action" status: 202 len: 0 microversion: 2.1 time: 0.079260 Jun 16 21:16:28.246644 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 301/556] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 16 21:16:28 2022] POST /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:16:28.254672 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a13c1a7a-f8f8-432e-91b7-51c2bf18dd55 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:28.255286 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a13c1a7a-f8f8-432e-91b7-51c2bf18dd55 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:28.262608 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a13c1a7a-f8f8-432e-91b7-51c2bf18dd55 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:28.263207 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a13c1a7a-f8f8-432e-91b7-51c2bf18dd55 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:28.263794 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a13c1a7a-f8f8-432e-91b7-51c2bf18dd55 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:28.264254 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a13c1a7a-f8f8-432e-91b7-51c2bf18dd55 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:28.410576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a13c1a7a-f8f8-432e-91b7-51c2bf18dd55 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:28.418424 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a13c1a7a-f8f8-432e-91b7-51c2bf18dd55 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1510 microversion: 2.1 time: 0.167532 Jun 16 21:16:28.418988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 256/557] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:28 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:28.445081 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b61dadc0-4150-441a-bc2a-a0e13a0e4d27 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:28.446063 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b61dadc0-4150-441a-bc2a-a0e13a0e4d27 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:28.452432 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b61dadc0-4150-441a-bc2a-a0e13a0e4d27 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:28.452872 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b61dadc0-4150-441a-bc2a-a0e13a0e4d27 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:28.453624 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b61dadc0-4150-441a-bc2a-a0e13a0e4d27 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:28.454098 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b61dadc0-4150-441a-bc2a-a0e13a0e4d27 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:28.584997 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b61dadc0-4150-441a-bc2a-a0e13a0e4d27 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:28.593584 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b61dadc0-4150-441a-bc2a-a0e13a0e4d27 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:28.595059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b61dadc0-4150-441a-bc2a-a0e13a0e4d27 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:28.596231 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b61dadc0-4150-441a-bc2a-a0e13a0e4d27 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.155476 Jun 16 21:16:28.596782 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 302/558] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:28 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:28.718046 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c65fce7d-7587-475e-b7fc-2d80269d81b8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:28.718627 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c65fce7d-7587-475e-b7fc-2d80269d81b8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:28.724603 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c65fce7d-7587-475e-b7fc-2d80269d81b8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:28.725046 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c65fce7d-7587-475e-b7fc-2d80269d81b8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:28.725802 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c65fce7d-7587-475e-b7fc-2d80269d81b8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:28.726232 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c65fce7d-7587-475e-b7fc-2d80269d81b8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:28.860643 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c65fce7d-7587-475e-b7fc-2d80269d81b8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:28.869331 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c65fce7d-7587-475e-b7fc-2d80269d81b8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1713 microversion: 2.1 time: 0.155151 Jun 16 21:16:28.869899 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 257/559] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:28 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:28.943946 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1b9a1184-988b-4294-9e1f-b65f5c8388df tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:28.944570 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1b9a1184-988b-4294-9e1f-b65f5c8388df tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:28.951715 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1b9a1184-988b-4294-9e1f-b65f5c8388df tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:28.952160 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1b9a1184-988b-4294-9e1f-b65f5c8388df tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:28.952971 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1b9a1184-988b-4294-9e1f-b65f5c8388df tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:28.953404 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1b9a1184-988b-4294-9e1f-b65f5c8388df tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:28.971484 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:29.338112 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1b9a1184-988b-4294-9e1f-b65f5c8388df tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:29.345599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1b9a1184-988b-4294-9e1f-b65f5c8388df tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1319 microversion: 2.1 time: 0.405449 Jun 16 21:16:29.346164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 303/560] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:28 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1319 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:29.435682 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-53bc937f-a630-4b88-b9cb-9f392af473f5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:29.436342 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-53bc937f-a630-4b88-b9cb-9f392af473f5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:29.442832 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-53bc937f-a630-4b88-b9cb-9f392af473f5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:29.443282 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-53bc937f-a630-4b88-b9cb-9f392af473f5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:29.444045 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-53bc937f-a630-4b88-b9cb-9f392af473f5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:29.444522 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-53bc937f-a630-4b88-b9cb-9f392af473f5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:29.448601 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:29.578827 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-53bc937f-a630-4b88-b9cb-9f392af473f5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:29.586959 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-53bc937f-a630-4b88-b9cb-9f392af473f5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1510 microversion: 2.1 time: 0.155069 Jun 16 21:16:29.587518 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 258/561] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:29 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:29.614962 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8bdc6be0-756a-4c32-b0c9-9d656a655744 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:29.615563 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8bdc6be0-756a-4c32-b0c9-9d656a655744 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:29.621867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8bdc6be0-756a-4c32-b0c9-9d656a655744 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:29.622304 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8bdc6be0-756a-4c32-b0c9-9d656a655744 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:29.623049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8bdc6be0-756a-4c32-b0c9-9d656a655744 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:29.623473 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8bdc6be0-756a-4c32-b0c9-9d656a655744 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:29.712850 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 21:16:29.713132 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Thu Jun 16 21:16:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 21:16:29.792790 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8bdc6be0-756a-4c32-b0c9-9d656a655744 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:29.801018 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8bdc6be0-756a-4c32-b0c9-9d656a655744 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:29.802501 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8bdc6be0-756a-4c32-b0c9-9d656a655744 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:29.803639 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8bdc6be0-756a-4c32-b0c9-9d656a655744 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.192830 Jun 16 21:16:29.804201 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 304/562] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:29 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:30.364401 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2b86a23d-755e-4a63-a772-07b111817ef3 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:30.365013 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2b86a23d-755e-4a63-a772-07b111817ef3 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:30.367460 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=96 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:30.373480 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2b86a23d-755e-4a63-a772-07b111817ef3 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:30.373923 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2b86a23d-755e-4a63-a772-07b111817ef3 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:30.374674 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2b86a23d-755e-4a63-a772-07b111817ef3 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:30.375096 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2b86a23d-755e-4a63-a772-07b111817ef3 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:30.510747 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2b86a23d-755e-4a63-a772-07b111817ef3 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:30.518235 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2b86a23d-755e-4a63-a772-07b111817ef3 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1319 microversion: 2.1 time: 0.157977 Jun 16 21:16:30.518791 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 259/563] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:30 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:30.604316 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0752e324-9ba7-47c3-9ee9-45caf9ca9aeb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:30.604965 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0752e324-9ba7-47c3-9ee9-45caf9ca9aeb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:30.610972 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0752e324-9ba7-47c3-9ee9-45caf9ca9aeb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:30.611419 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0752e324-9ba7-47c3-9ee9-45caf9ca9aeb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:30.612212 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0752e324-9ba7-47c3-9ee9-45caf9ca9aeb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:30.612646 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0752e324-9ba7-47c3-9ee9-45caf9ca9aeb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:30.822705 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-cd22cc16-2bae-4cd5-9c10-29d60843aa96 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:30.823345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-cd22cc16-2bae-4cd5-9c10-29d60843aa96 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:30.829257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cd22cc16-2bae-4cd5-9c10-29d60843aa96 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:30.829701 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cd22cc16-2bae-4cd5-9c10-29d60843aa96 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:30.830464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cd22cc16-2bae-4cd5-9c10-29d60843aa96 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:30.830897 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cd22cc16-2bae-4cd5-9c10-29d60843aa96 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:30.872649 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0752e324-9ba7-47c3-9ee9-45caf9ca9aeb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:30.880001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0752e324-9ba7-47c3-9ee9-45caf9ca9aeb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1510 microversion: 2.1 time: 0.279885 Jun 16 21:16:30.880598 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 305/564] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:30 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1510 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:30.960690 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-cd22cc16-2bae-4cd5-9c10-29d60843aa96 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:30.969370 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-cd22cc16-2bae-4cd5-9c10-29d60843aa96 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:30.970868 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-cd22cc16-2bae-4cd5-9c10-29d60843aa96 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:30.972032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-cd22cc16-2bae-4cd5-9c10-29d60843aa96 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.153738 Jun 16 21:16:30.972611 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 260/565] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:30 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:16:31.534804 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-589499d4-147d-444d-8f2c-a147b1baa16d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:31.535407 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-589499d4-147d-444d-8f2c-a147b1baa16d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:31.542111 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-589499d4-147d-444d-8f2c-a147b1baa16d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:31.542550 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-589499d4-147d-444d-8f2c-a147b1baa16d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:31.543301 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-589499d4-147d-444d-8f2c-a147b1baa16d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:31.543729 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-589499d4-147d-444d-8f2c-a147b1baa16d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:31.734149 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-589499d4-147d-444d-8f2c-a147b1baa16d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:31.741709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-589499d4-147d-444d-8f2c-a147b1baa16d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1319 microversion: 2.1 time: 0.210774 Jun 16 21:16:31.742380 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 306/566] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:31 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:31.896846 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-877b5716-a53f-49d4-a283-0c7ad1b4e18f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:31.897455 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-877b5716-a53f-49d4-a283-0c7ad1b4e18f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:31.904539 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-877b5716-a53f-49d4-a283-0c7ad1b4e18f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:31.904982 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-877b5716-a53f-49d4-a283-0c7ad1b4e18f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:31.905737 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-877b5716-a53f-49d4-a283-0c7ad1b4e18f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:31.906164 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-877b5716-a53f-49d4-a283-0c7ad1b4e18f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:31.991098 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-6ac76603-2064-4f6a-bef7-382c0acf257f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:31.992291 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-6ac76603-2064-4f6a-bef7-382c0acf257f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:31.998629 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6ac76603-2064-4f6a-bef7-382c0acf257f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:31.999170 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6ac76603-2064-4f6a-bef7-382c0acf257f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:32.000012 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6ac76603-2064-4f6a-bef7-382c0acf257f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:32.000938 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6ac76603-2064-4f6a-bef7-382c0acf257f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:32.039184 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-877b5716-a53f-49d4-a283-0c7ad1b4e18f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:32.046936 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-877b5716-a53f-49d4-a283-0c7ad1b4e18f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1510 microversion: 2.1 time: 0.153888 Jun 16 21:16:32.047528 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 261/567] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:31 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:32.138504 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6ac76603-2064-4f6a-bef7-382c0acf257f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:32.146957 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6ac76603-2064-4f6a-bef7-382c0acf257f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:32.148930 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6ac76603-2064-4f6a-bef7-382c0acf257f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:32.150220 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-6ac76603-2064-4f6a-bef7-382c0acf257f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.163419 Jun 16 21:16:32.159044 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 307/568] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:31 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:16:32.758992 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-eab92f41-6595-424c-9931-422fef43d920 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:32.759549 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-eab92f41-6595-424c-9931-422fef43d920 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:32.765627 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-eab92f41-6595-424c-9931-422fef43d920 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:32.766070 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-eab92f41-6595-424c-9931-422fef43d920 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:32.766851 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-eab92f41-6595-424c-9931-422fef43d920 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:32.767276 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-eab92f41-6595-424c-9931-422fef43d920 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:32.898472 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-eab92f41-6595-424c-9931-422fef43d920 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:32.906388 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-eab92f41-6595-424c-9931-422fef43d920 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1319 microversion: 2.1 time: 0.151977 Jun 16 21:16:32.906945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 262/569] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:32 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:33.064475 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4dc0b735-3bb0-4a10-a3b4-1c9ff4911108 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:33.065195 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4dc0b735-3bb0-4a10-a3b4-1c9ff4911108 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:33.071901 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4dc0b735-3bb0-4a10-a3b4-1c9ff4911108 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:33.072379 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4dc0b735-3bb0-4a10-a3b4-1c9ff4911108 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:33.073137 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4dc0b735-3bb0-4a10-a3b4-1c9ff4911108 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:33.073561 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4dc0b735-3bb0-4a10-a3b4-1c9ff4911108 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:33.169763 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-744f0a8a-c4a7-465f-99a5-cf7f28aaaec9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:33.170793 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-744f0a8a-c4a7-465f-99a5-cf7f28aaaec9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:33.177096 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-744f0a8a-c4a7-465f-99a5-cf7f28aaaec9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:33.177663 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-744f0a8a-c4a7-465f-99a5-cf7f28aaaec9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:33.178435 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-744f0a8a-c4a7-465f-99a5-cf7f28aaaec9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:33.178858 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-744f0a8a-c4a7-465f-99a5-cf7f28aaaec9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:33.204585 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4dc0b735-3bb0-4a10-a3b4-1c9ff4911108 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:33.212655 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4dc0b735-3bb0-4a10-a3b4-1c9ff4911108 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1510 microversion: 2.1 time: 0.151868 Jun 16 21:16:33.213237 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 308/570] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:33 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:33.311248 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-744f0a8a-c4a7-465f-99a5-cf7f28aaaec9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:33.319825 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-744f0a8a-c4a7-465f-99a5-cf7f28aaaec9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:33.321736 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-744f0a8a-c4a7-465f-99a5-cf7f28aaaec9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:33.322904 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-744f0a8a-c4a7-465f-99a5-cf7f28aaaec9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.157429 Jun 16 21:16:33.323467 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 263/571] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:33 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:16:33.922825 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-80f420f6-aa60-4d11-be03-a0af4553990e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:33.923354 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-80f420f6-aa60-4d11-be03-a0af4553990e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:33.929454 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-80f420f6-aa60-4d11-be03-a0af4553990e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:33.929900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-80f420f6-aa60-4d11-be03-a0af4553990e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:33.931314 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-80f420f6-aa60-4d11-be03-a0af4553990e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:33.931748 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-80f420f6-aa60-4d11-be03-a0af4553990e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:34.060902 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-80f420f6-aa60-4d11-be03-a0af4553990e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:34.068229 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-80f420f6-aa60-4d11-be03-a0af4553990e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1319 microversion: 2.1 time: 0.149313 Jun 16 21:16:34.068791 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 309/572] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:33 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:34.229262 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0c4d9745-98e5-4f75-8e16-47c90175ec5d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:34.229790 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0c4d9745-98e5-4f75-8e16-47c90175ec5d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:34.236222 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0c4d9745-98e5-4f75-8e16-47c90175ec5d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:34.236671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0c4d9745-98e5-4f75-8e16-47c90175ec5d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:34.237426 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0c4d9745-98e5-4f75-8e16-47c90175ec5d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:34.237852 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0c4d9745-98e5-4f75-8e16-47c90175ec5d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:34.341640 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-bc3bb7de-b2e5-4d3b-904d-a818fe871ab5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:34.342254 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-bc3bb7de-b2e5-4d3b-904d-a818fe871ab5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:34.346130 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=100 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:34.349337 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bc3bb7de-b2e5-4d3b-904d-a818fe871ab5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:34.349785 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bc3bb7de-b2e5-4d3b-904d-a818fe871ab5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:34.350743 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bc3bb7de-b2e5-4d3b-904d-a818fe871ab5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:34.350994 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bc3bb7de-b2e5-4d3b-904d-a818fe871ab5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:34.369663 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0c4d9745-98e5-4f75-8e16-47c90175ec5d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:34.377302 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0c4d9745-98e5-4f75-8e16-47c90175ec5d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1510 microversion: 2.1 time: 0.152541 Jun 16 21:16:34.378063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 264/573] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:34 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:34.490513 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bc3bb7de-b2e5-4d3b-904d-a818fe871ab5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:34.501736 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bc3bb7de-b2e5-4d3b-904d-a818fe871ab5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:34.503306 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bc3bb7de-b2e5-4d3b-904d-a818fe871ab5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:34.504472 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-bc3bb7de-b2e5-4d3b-904d-a818fe871ab5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.167019 Jun 16 21:16:34.505349 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 310/574] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:34 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:16:34.536656 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b33064bd-3de0-4d29-a0a5-f73167c418e0 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:34.537256 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b33064bd-3de0-4d29-a0a5-f73167c418e0 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:34.543473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b33064bd-3de0-4d29-a0a5-f73167c418e0 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:34.543909 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b33064bd-3de0-4d29-a0a5-f73167c418e0 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:34.544692 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b33064bd-3de0-4d29-a0a5-f73167c418e0 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:34.545112 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b33064bd-3de0-4d29-a0a5-f73167c418e0 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:34.635171 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-a92086f9-4197-4ed3-8bea-85d0051cc42d req-f908fe79-c904-4f26-ad50-0f6f55257137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2281b8c3-ec1f-478b-bd50-128d5cf67a04", "name": "network-vif-plugged", "status": "completed", "tag": "6473309c-d2e4-42b4-94b1-6b373a5e59f2"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:34.643734 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-a92086f9-4197-4ed3-8bea-85d0051cc42d req-f908fe79-c904-4f26-ad50-0f6f55257137 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:34.644271 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-a92086f9-4197-4ed3-8bea-85d0051cc42d req-f908fe79-c904-4f26-ad50-0f6f55257137 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:34.656708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-a92086f9-4197-4ed3-8bea-85d0051cc42d req-f908fe79-c904-4f26-ad50-0f6f55257137 service nova] Creating event network-vif-plugged:6473309c-d2e4-42b4-94b1-6b373a5e59f2 for instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 on hv-cinder-81914 Jun 16 21:16:34.661569 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-a92086f9-4197-4ed3-8bea-85d0051cc42d req-f908fe79-c904-4f26-ad50-0f6f55257137 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030621 Jun 16 21:16:34.662396 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 311/575] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:16:34.683777 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b33064bd-3de0-4d29-a0a5-f73167c418e0 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:34.691621 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b33064bd-3de0-4d29-a0a5-f73167c418e0 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1595 microversion: 2.1 time: 0.158776 Jun 16 21:16:34.692205 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 265/576] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:34 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:35.086130 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-eb4bdc81-d4d2-4c86-ad77-af3db6541523 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:35.087621 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-eb4bdc81-d4d2-4c86-ad77-af3db6541523 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:35.099760 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-eb4bdc81-d4d2-4c86-ad77-af3db6541523 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:35.100308 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-eb4bdc81-d4d2-4c86-ad77-af3db6541523 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:35.101057 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-eb4bdc81-d4d2-4c86-ad77-af3db6541523 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:35.101475 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-eb4bdc81-d4d2-4c86-ad77-af3db6541523 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:35.292573 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-eb4bdc81-d4d2-4c86-ad77-af3db6541523 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:35.299903 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-eb4bdc81-d4d2-4c86-ad77-af3db6541523 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1319 microversion: 2.1 time: 0.218203 Jun 16 21:16:35.300705 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 312/577] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:35 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:35.394482 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-ebbbc07f-63d8-42c4-8bb6-00607fe3f6fe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:35.395093 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-ebbbc07f-63d8-42c4-8bb6-00607fe3f6fe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:35.403084 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ebbbc07f-63d8-42c4-8bb6-00607fe3f6fe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:35.403642 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ebbbc07f-63d8-42c4-8bb6-00607fe3f6fe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:35.404562 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ebbbc07f-63d8-42c4-8bb6-00607fe3f6fe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:35.405232 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ebbbc07f-63d8-42c4-8bb6-00607fe3f6fe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:35.523595 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a0353b2b-7851-4e8f-b20a-211c80e8bad3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:35.524689 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a0353b2b-7851-4e8f-b20a-211c80e8bad3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:35.531484 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a0353b2b-7851-4e8f-b20a-211c80e8bad3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:35.532019 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a0353b2b-7851-4e8f-b20a-211c80e8bad3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:35.532900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a0353b2b-7851-4e8f-b20a-211c80e8bad3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:35.533407 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a0353b2b-7851-4e8f-b20a-211c80e8bad3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:35.554477 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-ebbbc07f-63d8-42c4-8bb6-00607fe3f6fe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:35.564593 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-ebbbc07f-63d8-42c4-8bb6-00607fe3f6fe tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1516 microversion: 2.1 time: 0.173772 Jun 16 21:16:35.573546 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 266/578] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:35 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:35.938732 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a0353b2b-7851-4e8f-b20a-211c80e8bad3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:35.948338 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a0353b2b-7851-4e8f-b20a-211c80e8bad3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:35.950076 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a0353b2b-7851-4e8f-b20a-211c80e8bad3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:35.951253 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a0353b2b-7851-4e8f-b20a-211c80e8bad3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.431650 Jun 16 21:16:35.951972 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 313/579] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:35 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:16:36.316564 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1082ed33-ed96-4a6e-afa2-09a95a99d448 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:36.317169 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1082ed33-ed96-4a6e-afa2-09a95a99d448 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:36.323769 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1082ed33-ed96-4a6e-afa2-09a95a99d448 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:36.324223 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1082ed33-ed96-4a6e-afa2-09a95a99d448 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:36.324978 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1082ed33-ed96-4a6e-afa2-09a95a99d448 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:36.325405 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1082ed33-ed96-4a6e-afa2-09a95a99d448 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:36.458629 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1082ed33-ed96-4a6e-afa2-09a95a99d448 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:36.466745 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1082ed33-ed96-4a6e-afa2-09a95a99d448 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1319 microversion: 2.1 time: 0.153896 Jun 16 21:16:36.467439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 267/580] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:36 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:36.895194 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-160c690f-d1b1-4975-8e89-e2f0618fc2b9 req-8e0ea23a-70f3-4289-a948-912569c1b7aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec1e2cd-9bb8-4602-9f96-77478cfc9af8", "tag": "f26fce3f-5e61-4002-98b6-275c3b72e9db"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:36.904018 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-160c690f-d1b1-4975-8e89-e2f0618fc2b9 req-8e0ea23a-70f3-4289-a948-912569c1b7aa service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:36.904475 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-160c690f-d1b1-4975-8e89-e2f0618fc2b9 req-8e0ea23a-70f3-4289-a948-912569c1b7aa service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:36.916269 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-160c690f-d1b1-4975-8e89-e2f0618fc2b9 req-8e0ea23a-70f3-4289-a948-912569c1b7aa service nova] Creating event network-changed:f26fce3f-5e61-4002-98b6-275c3b72e9db for instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 on hv-cinder-81914 Jun 16 21:16:36.921684 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-160c690f-d1b1-4975-8e89-e2f0618fc2b9 req-8e0ea23a-70f3-4289-a948-912569c1b7aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030032 Jun 16 21:16:36.925248 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 314/581] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:16:36.953413 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1800da3d-405d-4856-a38d-eb2327e0f1e3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Action: 'create', calling method: .version_select at 0x7fb3f76d73a0>, body: {"keypair": {"name": "tempest-keypair-1234058811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAbtodhT4fbYV8+MELWdcVp3FxaKU/fhCu2IAQmhXvbZekFxPKVHh3cdJ6xjb4AQeXGYNdCljA3evCprjTXvJig2RGIquZbh8OYx+9WC758fLCnV/0qV21ncjN7Ha/ZVQ=="}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:36.969763 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-1800da3d-405d-4856-a38d-eb2327e0f1e3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Getting quotas for project 6b341c2d77764f3890f2501cfc6945a7. Resources: {'key_pairs'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:16:36.974548 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-1800da3d-405d-4856-a38d-eb2327e0f1e3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Getting quotas for user 1d410832e6584828875128e31baa0ae8 and project 6b341c2d77764f3890f2501cfc6945a7. Resources: {'key_pairs'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:16:36.976657 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-62861527-580d-4856-a932-703537c7fdf5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:36.978520 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-62861527-580d-4856-a932-703537c7fdf5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:36.986762 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-62861527-580d-4856-a932-703537c7fdf5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:36.987523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-62861527-580d-4856-a932-703537c7fdf5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:36.988682 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-62861527-580d-4856-a932-703537c7fdf5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:36.989576 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-62861527-580d-4856-a932-703537c7fdf5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:37.004378 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1800da3d-405d-4856-a38d-eb2327e0f1e3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054278 Jun 16 21:16:37.006219 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 268/582] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 16 21:16:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:16:37.267206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-62861527-580d-4856-a932-703537c7fdf5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:37.278981 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-62861527-580d-4856-a932-703537c7fdf5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:37.281000 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-62861527-580d-4856-a932-703537c7fdf5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:37.282495 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-62861527-580d-4856-a932-703537c7fdf5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.315140 Jun 16 21:16:37.293624 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 315/583] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:36 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:37.484596 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-e8467efe-e609-4086-a5ce-dd53e3f9a327 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:37.486545 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-e8467efe-e609-4086-a5ce-dd53e3f9a327 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:37.494009 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e8467efe-e609-4086-a5ce-dd53e3f9a327 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:37.494676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e8467efe-e609-4086-a5ce-dd53e3f9a327 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:37.495915 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e8467efe-e609-4086-a5ce-dd53e3f9a327 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:37.496591 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e8467efe-e609-4086-a5ce-dd53e3f9a327 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:37.739822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-e8467efe-e609-4086-a5ce-dd53e3f9a327 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:37.751882 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-e8467efe-e609-4086-a5ce-dd53e3f9a327 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1319 microversion: 2.1 time: 0.271610 Jun 16 21:16:37.754074 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 269/584] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:37 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:38.301046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-786c144d-7db5-4a71-9bdb-04a80de5bfa7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:38.301664 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-786c144d-7db5-4a71-9bdb-04a80de5bfa7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:38.309345 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-786c144d-7db5-4a71-9bdb-04a80de5bfa7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:38.310648 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-786c144d-7db5-4a71-9bdb-04a80de5bfa7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:38.311620 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-786c144d-7db5-4a71-9bdb-04a80de5bfa7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:38.312575 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-786c144d-7db5-4a71-9bdb-04a80de5bfa7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:38.612415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7229c4eb-8295-47ed-a2e6-b296a0fe7576 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-550072689"}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:38.613208 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7229c4eb-8295-47ed-a2e6-b296a0fe7576 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:38.618851 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-786c144d-7db5-4a71-9bdb-04a80de5bfa7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:38.631034 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-786c144d-7db5-4a71-9bdb-04a80de5bfa7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:38.632916 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-786c144d-7db5-4a71-9bdb-04a80de5bfa7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:38.634506 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7229c4eb-8295-47ed-a2e6-b296a0fe7576 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:38.635511 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-786c144d-7db5-4a71-9bdb-04a80de5bfa7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1806 microversion: 2.20 time: 0.338384 Jun 16 21:16:38.640733 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7229c4eb-8295-47ed-a2e6-b296a0fe7576 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:38.642248 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7229c4eb-8295-47ed-a2e6-b296a0fe7576 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:38.642700 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7229c4eb-8295-47ed-a2e6-b296a0fe7576 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:38.647965 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 316/585] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:38 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1806 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:38.775425 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-20287bae-08c0-4c5c-a463-00008b766230 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:38.776368 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-20287bae-08c0-4c5c-a463-00008b766230 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:38.785384 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-20287bae-08c0-4c5c-a463-00008b766230 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:38.785967 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-20287bae-08c0-4c5c-a463-00008b766230 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:38.787698 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-20287bae-08c0-4c5c-a463-00008b766230 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:38.788358 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-20287bae-08c0-4c5c-a463-00008b766230 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:38.969471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.network.security_group_api [None req-7229c4eb-8295-47ed-a2e6-b296a0fe7576 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Adding security group c19dd2ec-0bff-4018-916c-55304561aea6 to port f26fce3f-5e61-4002-98b6-275c3b72e9db Jun 16 21:16:39.016260 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-20287bae-08c0-4c5c-a463-00008b766230 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:39.025623 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-20287bae-08c0-4c5c-a463-00008b766230 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1319 microversion: 2.1 time: 0.257133 Jun 16 21:16:39.026545 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 317/586] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:38 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:39.032026 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-c3db3a81-e87b-4040-b890-bec49f5810a0 req-65d542c3-3da4-4317-952a-1e10038ae2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0c875b-5859-4684-8846-25255f38cc90", "name": "network-vif-plugged", "status": "completed", "tag": "0bea97fe-a1f6-4344-b4a0-a56b13b5543c"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:39.040889 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-c3db3a81-e87b-4040-b890-bec49f5810a0 req-65d542c3-3da4-4317-952a-1e10038ae2f1 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:39.041515 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-c3db3a81-e87b-4040-b890-bec49f5810a0 req-65d542c3-3da4-4317-952a-1e10038ae2f1 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:39.053157 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-c3db3a81-e87b-4040-b890-bec49f5810a0 req-65d542c3-3da4-4317-952a-1e10038ae2f1 service nova] Creating event network-vif-plugged:0bea97fe-a1f6-4344-b4a0-a56b13b5543c for instance 1a0c875b-5859-4684-8846-25255f38cc90 on hv-cinder-81914 Jun 16 21:16:39.059090 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-c3db3a81-e87b-4040-b890-bec49f5810a0 req-65d542c3-3da4-4317-952a-1e10038ae2f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030945 Jun 16 21:16:39.059891 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 318/587] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:16:39.068684 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d0d994b9-e4ae-4f08-9026-aaa2e6d8d1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2141488741", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a845e201-b1f1-498f-803f-02b706e2fd26"}], "security_groups": [{"name": "tempest-securitygroup--1134952200"}], "key_name": "tempest-keypair-1234058811", "user_data": "}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:39.188996 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.network.neutron [None req-d0d994b9-e4ae-4f08-9026-aaa2e6d8d1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] validate_networks() for [('a845e201-b1f1-498f-803f-02b706e2fd26', None, None, None, None, None)] {{(pid=117737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:16:39.387640 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7229c4eb-8295-47ed-a2e6-b296a0fe7576 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "POST /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/action" status: 202 len: 0 microversion: 2.1 time: 0.781658 Jun 16 21:16:39.391340 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 270/588] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 16 21:16:38 2022] POST /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/action => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:16:39.396432 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-57ec6b09-3391-4cd1-9df5-7ee30bb3742a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:39.397150 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-57ec6b09-3391-4cd1-9df5-7ee30bb3742a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:39.404618 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-57ec6b09-3391-4cd1-9df5-7ee30bb3742a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:39.405323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-57ec6b09-3391-4cd1-9df5-7ee30bb3742a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:39.406304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-57ec6b09-3391-4cd1-9df5-7ee30bb3742a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:39.406949 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-57ec6b09-3391-4cd1-9df5-7ee30bb3742a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:39.608578 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-57ec6b09-3391-4cd1-9df5-7ee30bb3742a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:39.620702 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-57ec6b09-3391-4cd1-9df5-7ee30bb3742a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1760 microversion: 2.1 time: 0.227890 Jun 16 21:16:39.623513 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 271/589] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:39 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1760 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:39.636050 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-35fa0009-5e7b-4cfe-9d5e-6bf691edfdf8 req-6daeb037-9f5b-49ac-bd38-5fc821a5d2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec1e2cd-9bb8-4602-9f96-77478cfc9af8", "tag": "f26fce3f-5e61-4002-98b6-275c3b72e9db"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:39.645607 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-35fa0009-5e7b-4cfe-9d5e-6bf691edfdf8 req-6daeb037-9f5b-49ac-bd38-5fc821a5d2c8 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:39.646050 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-35fa0009-5e7b-4cfe-9d5e-6bf691edfdf8 req-6daeb037-9f5b-49ac-bd38-5fc821a5d2c8 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:39.660804 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-35fa0009-5e7b-4cfe-9d5e-6bf691edfdf8 req-6daeb037-9f5b-49ac-bd38-5fc821a5d2c8 service nova] Creating event network-changed:f26fce3f-5e61-4002-98b6-275c3b72e9db for instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 on hv-cinder-81914 Jun 16 21:16:39.667558 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-35fa0009-5e7b-4cfe-9d5e-6bf691edfdf8 req-6daeb037-9f5b-49ac-bd38-5fc821a5d2c8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041948 Jun 16 21:16:39.668935 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 272/590] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:16:39.677018 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c03cb127-d531-42f2-b611-f02f7b40dfc5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:39.678670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c03cb127-d531-42f2-b611-f02f7b40dfc5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:39.687200 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c03cb127-d531-42f2-b611-f02f7b40dfc5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:39.687884 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c03cb127-d531-42f2-b611-f02f7b40dfc5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:39.688840 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c03cb127-d531-42f2-b611-f02f7b40dfc5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:39.689606 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c03cb127-d531-42f2-b611-f02f7b40dfc5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:39.717984 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-d0d994b9-e4ae-4f08-9026-aaa2e6d8d1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Flavor limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:16:39.718491 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-d0d994b9-e4ae-4f08-9026-aaa2e6d8d1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Image limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:16:39.718861 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-d0d994b9-e4ae-4f08-9026-aaa2e6d8d1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Flavor pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:16:39.719273 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-d0d994b9-e4ae-4f08-9026-aaa2e6d8d1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Image pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:16:39.719710 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-d0d994b9-e4ae-4f08-9026-aaa2e6d8d1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:16:39.728883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d0d994b9-e4ae-4f08-9026-aaa2e6d8d1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:39.729650 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d0d994b9-e4ae-4f08-9026-aaa2e6d8d1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:39.730653 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d0d994b9-e4ae-4f08-9026-aaa2e6d8d1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:39.731434 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d0d994b9-e4ae-4f08-9026-aaa2e6d8d1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:39.750204 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-d0d994b9-e4ae-4f08-9026-aaa2e6d8d1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Getting quotas for project 6b341c2d77764f3890f2501cfc6945a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:16:39.755329 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-d0d994b9-e4ae-4f08-9026-aaa2e6d8d1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Getting quotas for user 1d410832e6584828875128e31baa0ae8 and project 6b341c2d77764f3890f2501cfc6945a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:16:39.769172 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d0d994b9-e4ae-4f08-9026-aaa2e6d8d1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Going to run 1 instances... {{(pid=117737) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:16:39.771673 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d0d994b9-e4ae-4f08-9026-aaa2e6d8d1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:16:39.830272 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d0d994b9-e4ae-4f08-9026-aaa2e6d8d1e0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.764856 Jun 16 21:16:39.836118 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 319/591] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:16:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:16:39.842097 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-093e9113-ddfe-44dd-b99e-cdd4d6b149e7 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:39.842708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-093e9113-ddfe-44dd-b99e-cdd4d6b149e7 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:39.901766 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c03cb127-d531-42f2-b611-f02f7b40dfc5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:39.913722 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c03cb127-d531-42f2-b611-f02f7b40dfc5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:39.915994 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c03cb127-d531-42f2-b611-f02f7b40dfc5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:39.917871 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c03cb127-d531-42f2-b611-f02f7b40dfc5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1793 microversion: 2.20 time: 0.247152 Jun 16 21:16:39.919408 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 273/592] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:16:39 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1793 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:16:39.950345 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-093e9113-ddfe-44dd-b99e-cdd4d6b149e7 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:39.958238 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-093e9113-ddfe-44dd-b99e-cdd4d6b149e7 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1246 microversion: 2.1 time: 0.120090 Jun 16 21:16:39.959454 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 320/593] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:39 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1246 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:40.042735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5fa876e5-0dd4-437e-a6fb-87f6e7d5ef98 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:40.043353 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5fa876e5-0dd4-437e-a6fb-87f6e7d5ef98 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:40.049709 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5fa876e5-0dd4-437e-a6fb-87f6e7d5ef98 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:40.050456 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5fa876e5-0dd4-437e-a6fb-87f6e7d5ef98 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:40.051291 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5fa876e5-0dd4-437e-a6fb-87f6e7d5ef98 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:40.052112 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5fa876e5-0dd4-437e-a6fb-87f6e7d5ef98 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:40.205676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5fa876e5-0dd4-437e-a6fb-87f6e7d5ef98 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:40.214277 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5fa876e5-0dd4-437e-a6fb-87f6e7d5ef98 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1319 microversion: 2.1 time: 0.175457 Jun 16 21:16:40.214858 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 274/594] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:40 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:40.976311 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4bb1b456-38b6-470c-a5aa-65e298c6a5d2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:40.976999 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4bb1b456-38b6-470c-a5aa-65e298c6a5d2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:40.983900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4bb1b456-38b6-470c-a5aa-65e298c6a5d2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:40.984391 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4bb1b456-38b6-470c-a5aa-65e298c6a5d2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:40.985157 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4bb1b456-38b6-470c-a5aa-65e298c6a5d2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:40.985591 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4bb1b456-38b6-470c-a5aa-65e298c6a5d2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:41.047012 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4bb1b456-38b6-470c-a5aa-65e298c6a5d2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:41.054336 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4bb1b456-38b6-470c-a5aa-65e298c6a5d2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1298 microversion: 2.1 time: 0.081927 Jun 16 21:16:41.054892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 321/595] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:40 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1298 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:41.231575 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d9111c6f-0811-4aad-8e22-c8c9e3c87007 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:41.232256 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d9111c6f-0811-4aad-8e22-c8c9e3c87007 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:41.238701 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9111c6f-0811-4aad-8e22-c8c9e3c87007 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:41.239403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9111c6f-0811-4aad-8e22-c8c9e3c87007 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:41.240168 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9111c6f-0811-4aad-8e22-c8c9e3c87007 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:41.240627 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9111c6f-0811-4aad-8e22-c8c9e3c87007 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:41.385872 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d9111c6f-0811-4aad-8e22-c8c9e3c87007 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:41.393623 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d9111c6f-0811-4aad-8e22-c8c9e3c87007 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1319 microversion: 2.1 time: 0.166580 Jun 16 21:16:41.403282 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 275/596] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:41 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:42.072533 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f55fb17a-34de-4e06-b99d-ca74d4e115f1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:42.073179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f55fb17a-34de-4e06-b99d-ca74d4e115f1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:42.080034 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f55fb17a-34de-4e06-b99d-ca74d4e115f1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:42.080508 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f55fb17a-34de-4e06-b99d-ca74d4e115f1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:42.081323 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f55fb17a-34de-4e06-b99d-ca74d4e115f1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:42.081754 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f55fb17a-34de-4e06-b99d-ca74d4e115f1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:42.144613 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f55fb17a-34de-4e06-b99d-ca74d4e115f1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:42.153277 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f55fb17a-34de-4e06-b99d-ca74d4e115f1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1304 microversion: 2.1 time: 0.085405 Jun 16 21:16:42.153845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 322/597] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:42 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1304 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:42.410740 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-96511851-be8a-47bc-b2fe-443951a3b932 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:42.411421 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-96511851-be8a-47bc-b2fe-443951a3b932 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:42.418034 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-96511851-be8a-47bc-b2fe-443951a3b932 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:42.418486 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-96511851-be8a-47bc-b2fe-443951a3b932 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:42.419255 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-96511851-be8a-47bc-b2fe-443951a3b932 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:42.419872 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-96511851-be8a-47bc-b2fe-443951a3b932 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:42.558204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-96511851-be8a-47bc-b2fe-443951a3b932 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:42.560529 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=100 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:42.567383 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-96511851-be8a-47bc-b2fe-443951a3b932 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1508 microversion: 2.1 time: 0.160576 Jun 16 21:16:42.568058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 276/598] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:42 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:42.583925 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-92a09041-9532-401b-84d9-adfce3ee402f tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e14af94-0b00-4ebb-8bbb-5a77641f025a", "device": "/dev/sdb"}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:42.585364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-92a09041-9532-401b-84d9-adfce3ee402f tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:42.596459 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-92a09041-9532-401b-84d9-adfce3ee402f tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:42.597123 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-92a09041-9532-401b-84d9-adfce3ee402f tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:42.597909 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-92a09041-9532-401b-84d9-adfce3ee402f tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:42.598342 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-92a09041-9532-401b-84d9-adfce3ee402f tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:42.676119 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=100 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:42.885621 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-92a09041-9532-401b-84d9-adfce3ee402f tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "POST /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305319 Jun 16 21:16:42.886585 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 323/599] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 16 21:16:42 2022] POST /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:16:43.171471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-f5ea20d7-b223-483f-b014-0c506844500c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:43.172155 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-f5ea20d7-b223-483f-b014-0c506844500c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:43.178957 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f5ea20d7-b223-483f-b014-0c506844500c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:43.179655 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f5ea20d7-b223-483f-b014-0c506844500c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:43.180410 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f5ea20d7-b223-483f-b014-0c506844500c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:43.180994 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f5ea20d7-b223-483f-b014-0c506844500c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:43.339846 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-f5ea20d7-b223-483f-b014-0c506844500c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:43.347483 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-f5ea20d7-b223-483f-b014-0c506844500c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1372 microversion: 2.1 time: 0.180966 Jun 16 21:16:43.348048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 277/600] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:43 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:43.595665 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-546aa5f0-58f1-4f86-ab0f-c0ab0f051a79 req-bae9d8e2-e9e5-406b-bf60-bd149516193e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24b1c256-3ab9-4d48-a2d3-eca09c3159f1", "tag": "05b93a42-bdde-493e-9e4e-b676213111c0"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:43.605031 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-546aa5f0-58f1-4f86-ab0f-c0ab0f051a79 req-bae9d8e2-e9e5-406b-bf60-bd149516193e service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:43.605686 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-546aa5f0-58f1-4f86-ab0f-c0ab0f051a79 req-bae9d8e2-e9e5-406b-bf60-bd149516193e service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:43.622665 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-546aa5f0-58f1-4f86-ab0f-c0ab0f051a79 req-bae9d8e2-e9e5-406b-bf60-bd149516193e service nova] Creating event network-changed:05b93a42-bdde-493e-9e4e-b676213111c0 for instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 on hv-cinder-81914 Jun 16 21:16:43.631202 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-546aa5f0-58f1-4f86-ab0f-c0ab0f051a79 req-bae9d8e2-e9e5-406b-bf60-bd149516193e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040788 Jun 16 21:16:43.631792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 324/601] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:16:44.365421 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-446bfc9d-248c-453b-aae0-a191b155c284 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:44.366030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-446bfc9d-248c-453b-aae0-a191b155c284 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:44.373175 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-446bfc9d-248c-453b-aae0-a191b155c284 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:44.373618 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-446bfc9d-248c-453b-aae0-a191b155c284 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:44.374374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-446bfc9d-248c-453b-aae0-a191b155c284 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:44.374832 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-446bfc9d-248c-453b-aae0-a191b155c284 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:44.506666 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-446bfc9d-248c-453b-aae0-a191b155c284 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:44.514764 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-446bfc9d-248c-453b-aae0-a191b155c284 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1372 microversion: 2.1 time: 0.153437 Jun 16 21:16:44.515321 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 278/602] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:44 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:45.532655 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-997e3a6c-f285-4a96-8da8-1e74f8437aed tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:45.533353 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-997e3a6c-f285-4a96-8da8-1e74f8437aed tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:45.539518 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-997e3a6c-f285-4a96-8da8-1e74f8437aed tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:45.539975 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-997e3a6c-f285-4a96-8da8-1e74f8437aed tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:45.540763 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-997e3a6c-f285-4a96-8da8-1e74f8437aed tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:45.541202 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-997e3a6c-f285-4a96-8da8-1e74f8437aed tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:45.756155 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-997e3a6c-f285-4a96-8da8-1e74f8437aed tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:45.764159 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-997e3a6c-f285-4a96-8da8-1e74f8437aed tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1372 microversion: 2.1 time: 0.236354 Jun 16 21:16:45.764739 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 325/603] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:45 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1372 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:46.781493 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c23d5dd1-f95d-433b-b7ef-12b60d706c79 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:46.782321 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c23d5dd1-f95d-433b-b7ef-12b60d706c79 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:46.789730 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c23d5dd1-f95d-433b-b7ef-12b60d706c79 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:46.790275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c23d5dd1-f95d-433b-b7ef-12b60d706c79 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:46.791045 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c23d5dd1-f95d-433b-b7ef-12b60d706c79 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:46.791472 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c23d5dd1-f95d-433b-b7ef-12b60d706c79 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:46.934585 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c23d5dd1-f95d-433b-b7ef-12b60d706c79 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:46.941868 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c23d5dd1-f95d-433b-b7ef-12b60d706c79 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1372 microversion: 2.1 time: 0.164758 Jun 16 21:16:46.942420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 279/604] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:46 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:47.958398 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0f997c5c-ee36-44f6-a9c1-de97bb0d8bbd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:47.959010 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0f997c5c-ee36-44f6-a9c1-de97bb0d8bbd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:47.967044 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0f997c5c-ee36-44f6-a9c1-de97bb0d8bbd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:47.967497 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0f997c5c-ee36-44f6-a9c1-de97bb0d8bbd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:47.968581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0f997c5c-ee36-44f6-a9c1-de97bb0d8bbd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:47.968740 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0f997c5c-ee36-44f6-a9c1-de97bb0d8bbd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:48.100134 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0f997c5c-ee36-44f6-a9c1-de97bb0d8bbd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:48.108141 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0f997c5c-ee36-44f6-a9c1-de97bb0d8bbd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1372 microversion: 2.1 time: 0.153584 Jun 16 21:16:48.108727 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 326/605] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:47 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:48.762100 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-81ed4790-29c3-44c3-a654-e843d93ae3df req-210f5645-dee8-4c3d-9f3f-1331fec0324d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24b1c256-3ab9-4d48-a2d3-eca09c3159f1", "name": "network-vif-plugged", "status": "completed", "tag": "05b93a42-bdde-493e-9e4e-b676213111c0"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:48.765749 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=4 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:48.772296 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-81ed4790-29c3-44c3-a654-e843d93ae3df req-210f5645-dee8-4c3d-9f3f-1331fec0324d service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:48.772848 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-81ed4790-29c3-44c3-a654-e843d93ae3df req-210f5645-dee8-4c3d-9f3f-1331fec0324d service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:48.785634 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-81ed4790-29c3-44c3-a654-e843d93ae3df req-210f5645-dee8-4c3d-9f3f-1331fec0324d service nova] Creating event network-vif-plugged:05b93a42-bdde-493e-9e4e-b676213111c0 for instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 on hv-cinder-81914 Jun 16 21:16:48.791198 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-81ed4790-29c3-44c3-a654-e843d93ae3df req-210f5645-dee8-4c3d-9f3f-1331fec0324d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033289 Jun 16 21:16:48.791781 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 280/606] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:16:49.124899 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-004842f7-ddcf-4661-a33d-ea2130aabeb6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:49.125502 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-004842f7-ddcf-4661-a33d-ea2130aabeb6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:49.131941 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-004842f7-ddcf-4661-a33d-ea2130aabeb6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:49.132406 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-004842f7-ddcf-4661-a33d-ea2130aabeb6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:49.133889 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-004842f7-ddcf-4661-a33d-ea2130aabeb6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:49.134412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-004842f7-ddcf-4661-a33d-ea2130aabeb6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:49.262314 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-004842f7-ddcf-4661-a33d-ea2130aabeb6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:49.269795 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-004842f7-ddcf-4661-a33d-ea2130aabeb6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1372 microversion: 2.1 time: 0.148647 Jun 16 21:16:49.270370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 327/607] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:49 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:50.287970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-bbb977a2-0a07-44b4-acbd-88369cbc744e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:50.288694 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-bbb977a2-0a07-44b4-acbd-88369cbc744e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:50.296039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bbb977a2-0a07-44b4-acbd-88369cbc744e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:50.296516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bbb977a2-0a07-44b4-acbd-88369cbc744e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:50.297278 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bbb977a2-0a07-44b4-acbd-88369cbc744e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:50.297708 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bbb977a2-0a07-44b4-acbd-88369cbc744e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:50.437707 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-bbb977a2-0a07-44b4-acbd-88369cbc744e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:50.445666 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-bbb977a2-0a07-44b4-acbd-88369cbc744e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1372 microversion: 2.1 time: 0.162345 Jun 16 21:16:50.446335 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 281/608] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:50 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:50.895603 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c101e0d0-88a3-4fc3-94d4-d17a0487b7ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:50.896141 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c101e0d0-88a3-4fc3-94d4-d17a0487b7ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:50.898137 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:50.899464 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=8 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:50.906176 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c101e0d0-88a3-4fc3-94d4-d17a0487b7ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:50.906643 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c101e0d0-88a3-4fc3-94d4-d17a0487b7ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:50.907404 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c101e0d0-88a3-4fc3-94d4-d17a0487b7ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:50.907826 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c101e0d0-88a3-4fc3-94d4-d17a0487b7ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:50.930644 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c101e0d0-88a3-4fc3-94d4-d17a0487b7ea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f/ips" status: 200 len: 151 microversion: 2.1 time: 0.038363 Jun 16 21:16:50.931198 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 328/609] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 16 21:16:50 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:16:50.941469 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-649ce769-cb0c-4d8c-b4be-3dd9e8df5c7d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc3bd7af-5846-41c2-a281-2859250c784c"}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:16:50.942510 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-649ce769-cb0c-4d8c-b4be-3dd9e8df5c7d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:50.949117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-649ce769-cb0c-4d8c-b4be-3dd9e8df5c7d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:50.949551 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-649ce769-cb0c-4d8c-b4be-3dd9e8df5c7d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:50.950291 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-649ce769-cb0c-4d8c-b4be-3dd9e8df5c7d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:50.950718 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-649ce769-cb0c-4d8c-b4be-3dd9e8df5c7d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:51.028104 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-649ce769-cb0c-4d8c-b4be-3dd9e8df5c7d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] HTTP exception thrown: Invalid volume: volume dc3bd7af-5846-41c2-a281-2859250c784c is already attached to instances: 397f70d9-d52e-42e2-9d9c-a5921d7632a0 Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-649ce769-cb0c-4d8c-b4be-3dd9e8df5c7d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Request method failure captured: Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: POST /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f/os-volume_attachments HTTP/1.1 Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 74 Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq5znrg1BlivpFkHnanzWccs2prlszc98SqsEUcUzeeIaKSEmJ9fzENTsjOpe5Qk_NQzgYSx59EKzIYY5fjkk4rwfyQQuYnSRsoplrpGBs8lpSHsUHoyoefKGRLOyWSvHcegVce7Q5IbVWJWykg-Seg-ZRUqsFo_eKeCcFzUevqUD7uU Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:16:51.029900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:16:51.031345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f22cbeb1402848dbb84a5718dca357e1"}]}] Jun 16 21:16:51.031345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:16:51.031345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:16:51.031345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:16:51.031345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:16:51.031345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:16:51.031345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:16:51.031345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 2cb12a51b62c48ba95be62f167b7314e Jun 16 21:16:51.031345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:16:51.031345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Jun 16 21:16:51.031345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {"volumeAttachment": {"volumeId": "dc3bd7af-5846-41c2-a281-2859250c784c"}} Jun 16 21:16:51.031345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Invalid volume: volume dc3bd7af-5846-41c2-a281-2859250c784c is already attached to instances: 397f70d9-d52e-42e2-9d9c-a5921d7632a0 Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'server_id': '7fe2c1e9-e3e7-437a-b627-53fa261bfe2f', 'body': {'volumeAttachment': {'volumeId': 'dc3bd7af-5846-41c2-a281-2859250c784c'}}} Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dc3bd7af-5846-41c2-a281-2859250c784c is already attached to instances: 397f70d9-d52e-42e2-9d9c-a5921d7632a0 Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:16:51.032323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dc3bd7af-5846-41c2-a281-2859250c784c is already attached to instances: 397f70d9-d52e-42e2-9d9c-a5921d7632a0 Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:16:51.033626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:16:51.035041 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:16:51.035041 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:16:51.035041 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:16:51.035041 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dc3bd7af-5846-41c2-a281-2859250c784c is already attached to instances: 397f70d9-d52e-42e2-9d9c-a5921d7632a0 Jun 16 21:16:51.035041 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:16:51.035041 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-649ce769-cb0c-4d8c-b4be-3dd9e8df5c7d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Returning 400 to user: Invalid volume: volume dc3bd7af-5846-41c2-a281-2859250c784c is already attached to instances: 397f70d9-d52e-42e2-9d9c-a5921d7632a0 {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:16:51.035041 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-649ce769-cb0c-4d8c-b4be-3dd9e8df5c7d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "POST /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093754 Jun 16 21:16:51.035041 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 282/610] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 16 21:16:50 2022] POST /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 21:16:51.040706 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c0b8afba-6ef5-4cea-93d8-c69b13147128 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:51.041210 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c0b8afba-6ef5-4cea-93d8-c69b13147128 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:51.047337 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c0b8afba-6ef5-4cea-93d8-c69b13147128 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:51.047778 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c0b8afba-6ef5-4cea-93d8-c69b13147128 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:51.048561 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c0b8afba-6ef5-4cea-93d8-c69b13147128 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:51.048991 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c0b8afba-6ef5-4cea-93d8-c69b13147128 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:51.074459 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c0b8afba-6ef5-4cea-93d8-c69b13147128 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Going to try to terminate instance {{(pid=117737) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:16:51.149503 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c0b8afba-6ef5-4cea-93d8-c69b13147128 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 204 len: 0 microversion: 2.1 time: 0.112731 Jun 16 21:16:51.149998 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 329/611] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:16:51 2022] DELETE /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:16:51.157999 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d56410b9-4631-4cc7-9426-e6a6b0925ef7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:51.158617 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d56410b9-4631-4cc7-9426-e6a6b0925ef7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:51.165673 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d56410b9-4631-4cc7-9426-e6a6b0925ef7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:51.166115 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d56410b9-4631-4cc7-9426-e6a6b0925ef7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:51.166882 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d56410b9-4631-4cc7-9426-e6a6b0925ef7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:51.167328 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d56410b9-4631-4cc7-9426-e6a6b0925ef7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:51.300631 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d56410b9-4631-4cc7-9426-e6a6b0925ef7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:51.309911 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d56410b9-4631-4cc7-9426-e6a6b0925ef7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1682 microversion: 2.1 time: 0.155633 Jun 16 21:16:51.310478 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 283/612] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:51 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:51.463363 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-845bc6ba-cee4-4c1c-8a19-c434e6768a26 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:51.463988 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-845bc6ba-cee4-4c1c-8a19-c434e6768a26 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:51.470020 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-845bc6ba-cee4-4c1c-8a19-c434e6768a26 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:51.470472 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-845bc6ba-cee4-4c1c-8a19-c434e6768a26 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:51.471236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-845bc6ba-cee4-4c1c-8a19-c434e6768a26 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:51.471670 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-845bc6ba-cee4-4c1c-8a19-c434e6768a26 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:51.601715 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-845bc6ba-cee4-4c1c-8a19-c434e6768a26 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:51.609643 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-845bc6ba-cee4-4c1c-8a19-c434e6768a26 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1372 microversion: 2.1 time: 0.150873 Jun 16 21:16:51.610222 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 330/613] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:51 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:52.328184 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-20bf9404-ddfe-4431-866e-3db18411df2c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:52.328833 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-20bf9404-ddfe-4431-866e-3db18411df2c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:52.335330 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-20bf9404-ddfe-4431-866e-3db18411df2c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:52.335774 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-20bf9404-ddfe-4431-866e-3db18411df2c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:52.337165 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-20bf9404-ddfe-4431-866e-3db18411df2c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:52.337593 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-20bf9404-ddfe-4431-866e-3db18411df2c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:52.463482 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-20bf9404-ddfe-4431-866e-3db18411df2c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:52.470873 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-20bf9404-ddfe-4431-866e-3db18411df2c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1682 microversion: 2.1 time: 0.146599 Jun 16 21:16:52.471431 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 284/614] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:52 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:52.627085 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a9b6e157-5690-46b6-9632-e165e7e2d930 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:52.627691 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a9b6e157-5690-46b6-9632-e165e7e2d930 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:52.634843 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a9b6e157-5690-46b6-9632-e165e7e2d930 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:52.635314 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a9b6e157-5690-46b6-9632-e165e7e2d930 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:52.636064 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a9b6e157-5690-46b6-9632-e165e7e2d930 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:52.636511 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a9b6e157-5690-46b6-9632-e165e7e2d930 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:52.765421 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a9b6e157-5690-46b6-9632-e165e7e2d930 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:52.772939 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a9b6e157-5690-46b6-9632-e165e7e2d930 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1372 microversion: 2.1 time: 0.149688 Jun 16 21:16:52.773503 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 331/615] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:52 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:53.488414 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4e809dc0-28f9-44d5-9c70-21b968cf870d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:53.488955 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4e809dc0-28f9-44d5-9c70-21b968cf870d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:53.496224 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4e809dc0-28f9-44d5-9c70-21b968cf870d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:53.496673 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4e809dc0-28f9-44d5-9c70-21b968cf870d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:53.497432 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4e809dc0-28f9-44d5-9c70-21b968cf870d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:53.497867 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4e809dc0-28f9-44d5-9c70-21b968cf870d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:53.790077 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-99540b57-ddc0-43db-948a-b8e58e49cd2d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:53.791019 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-99540b57-ddc0-43db-948a-b8e58e49cd2d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:53.797467 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-99540b57-ddc0-43db-948a-b8e58e49cd2d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:53.797906 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-99540b57-ddc0-43db-948a-b8e58e49cd2d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:53.798669 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-99540b57-ddc0-43db-948a-b8e58e49cd2d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:53.799095 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-99540b57-ddc0-43db-948a-b8e58e49cd2d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:53.858429 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4e809dc0-28f9-44d5-9c70-21b968cf870d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:53.866060 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4e809dc0-28f9-44d5-9c70-21b968cf870d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1682 microversion: 2.1 time: 0.381625 Jun 16 21:16:53.866619 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 285/616] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:53 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1682 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:53.933652 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-99540b57-ddc0-43db-948a-b8e58e49cd2d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:53.941068 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-99540b57-ddc0-43db-948a-b8e58e49cd2d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1372 microversion: 2.1 time: 0.155340 Jun 16 21:16:53.941621 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 332/617] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:53 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:54.883461 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3365b755-4c9f-47df-9445-d0a87482acfa tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:54.884003 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-3365b755-4c9f-47df-9445-d0a87482acfa tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:54.891910 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3365b755-4c9f-47df-9445-d0a87482acfa tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:54.892382 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3365b755-4c9f-47df-9445-d0a87482acfa tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:54.893141 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3365b755-4c9f-47df-9445-d0a87482acfa tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:54.893569 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3365b755-4c9f-47df-9445-d0a87482acfa tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:54.957626 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-53d3601d-2c04-471a-bc31-22a4fb16c4b4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:54.958242 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-53d3601d-2c04-471a-bc31-22a4fb16c4b4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:54.964669 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-53d3601d-2c04-471a-bc31-22a4fb16c4b4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:54.965136 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-53d3601d-2c04-471a-bc31-22a4fb16c4b4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:54.965918 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-53d3601d-2c04-471a-bc31-22a4fb16c4b4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:54.966353 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-53d3601d-2c04-471a-bc31-22a4fb16c4b4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:55.025712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-3365b755-4c9f-47df-9445-d0a87482acfa tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:55.033242 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-3365b755-4c9f-47df-9445-d0a87482acfa tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1682 microversion: 2.1 time: 0.153666 Jun 16 21:16:55.034178 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 286/618] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:54 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:55.092874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-53d3601d-2c04-471a-bc31-22a4fb16c4b4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:55.100820 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-53d3601d-2c04-471a-bc31-22a4fb16c4b4 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1372 microversion: 2.1 time: 0.146998 Jun 16 21:16:55.101383 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 333/619] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:54 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:56.050570 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0643f700-7b4f-45a4-a007-481baf73d4b4 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:56.051202 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0643f700-7b4f-45a4-a007-481baf73d4b4 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:56.058643 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0643f700-7b4f-45a4-a007-481baf73d4b4 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:56.059085 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0643f700-7b4f-45a4-a007-481baf73d4b4 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:56.059841 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0643f700-7b4f-45a4-a007-481baf73d4b4 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:56.060325 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0643f700-7b4f-45a4-a007-481baf73d4b4 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:56.118275 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-275927ac-a332-4a3b-908b-942a87870e9d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:56.118883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-275927ac-a332-4a3b-908b-942a87870e9d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:56.126138 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-275927ac-a332-4a3b-908b-942a87870e9d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:56.126576 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-275927ac-a332-4a3b-908b-942a87870e9d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:56.127327 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-275927ac-a332-4a3b-908b-942a87870e9d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:56.127751 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-275927ac-a332-4a3b-908b-942a87870e9d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:56.191867 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0643f700-7b4f-45a4-a007-481baf73d4b4 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:56.200051 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0643f700-7b4f-45a4-a007-481baf73d4b4 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1682 microversion: 2.1 time: 0.153382 Jun 16 21:16:56.200870 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 287/620] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:56 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:56.260747 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-275927ac-a332-4a3b-908b-942a87870e9d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:56.268045 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-275927ac-a332-4a3b-908b-942a87870e9d tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1372 microversion: 2.1 time: 0.153873 Jun 16 21:16:56.268641 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 334/621] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:56 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:57.217555 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7dd829d8-1ebf-4c4f-945c-61c9d4498007 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:57.218161 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7dd829d8-1ebf-4c4f-945c-61c9d4498007 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:57.224695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7dd829d8-1ebf-4c4f-945c-61c9d4498007 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:57.225132 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7dd829d8-1ebf-4c4f-945c-61c9d4498007 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:57.225878 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7dd829d8-1ebf-4c4f-945c-61c9d4498007 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:57.226299 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7dd829d8-1ebf-4c4f-945c-61c9d4498007 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:57.287212 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-22c72a7c-9a0b-4fa5-9bbf-9184cd90f39f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:57.288349 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-22c72a7c-9a0b-4fa5-9bbf-9184cd90f39f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:57.296723 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-22c72a7c-9a0b-4fa5-9bbf-9184cd90f39f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:57.297167 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-22c72a7c-9a0b-4fa5-9bbf-9184cd90f39f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:57.297941 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-22c72a7c-9a0b-4fa5-9bbf-9184cd90f39f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:57.298375 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-22c72a7c-9a0b-4fa5-9bbf-9184cd90f39f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:57.356285 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-7dd829d8-1ebf-4c4f-945c-61c9d4498007 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:57.363669 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7dd829d8-1ebf-4c4f-945c-61c9d4498007 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1682 microversion: 2.1 time: 0.150532 Jun 16 21:16:57.364509 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 288/622] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:57 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:57.427907 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-22c72a7c-9a0b-4fa5-9bbf-9184cd90f39f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:57.435963 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-22c72a7c-9a0b-4fa5-9bbf-9184cd90f39f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1372 microversion: 2.1 time: 0.153318 Jun 16 21:16:57.436531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 335/623] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:57 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:58.381917 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-27dfa0a8-87c3-4287-82cc-f3f6ff2d923c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:58.382527 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-27dfa0a8-87c3-4287-82cc-f3f6ff2d923c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:58.389778 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-27dfa0a8-87c3-4287-82cc-f3f6ff2d923c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:58.390221 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-27dfa0a8-87c3-4287-82cc-f3f6ff2d923c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:58.390973 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-27dfa0a8-87c3-4287-82cc-f3f6ff2d923c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:58.391401 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-27dfa0a8-87c3-4287-82cc-f3f6ff2d923c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:58.453179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a5707534-34e3-4b11-95ea-feea293ca022 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:58.453766 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a5707534-34e3-4b11-95ea-feea293ca022 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:58.460158 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a5707534-34e3-4b11-95ea-feea293ca022 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:58.460624 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a5707534-34e3-4b11-95ea-feea293ca022 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:58.461382 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a5707534-34e3-4b11-95ea-feea293ca022 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:58.461809 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a5707534-34e3-4b11-95ea-feea293ca022 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:58.527196 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-27dfa0a8-87c3-4287-82cc-f3f6ff2d923c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:58.534777 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-27dfa0a8-87c3-4287-82cc-f3f6ff2d923c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1682 microversion: 2.1 time: 0.156664 Jun 16 21:16:58.535349 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 289/624] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:58 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:58.594649 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a5707534-34e3-4b11-95ea-feea293ca022 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:58.602193 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a5707534-34e3-4b11-95ea-feea293ca022 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1372 microversion: 2.1 time: 0.152904 Jun 16 21:16:58.602766 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 336/625] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:58 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:16:59.551413 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6aa219c5-e82a-42e3-b4b8-14f2ae36053a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:59.552027 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6aa219c5-e82a-42e3-b4b8-14f2ae36053a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:59.559823 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6aa219c5-e82a-42e3-b4b8-14f2ae36053a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:59.560301 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6aa219c5-e82a-42e3-b4b8-14f2ae36053a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:59.561060 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6aa219c5-e82a-42e3-b4b8-14f2ae36053a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:59.561489 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6aa219c5-e82a-42e3-b4b8-14f2ae36053a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:59.623189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5ef25e44-78e6-490b-9ef9-eba99d471620 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:16:59.623804 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5ef25e44-78e6-490b-9ef9-eba99d471620 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:16:59.630308 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5ef25e44-78e6-490b-9ef9-eba99d471620 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:59.630755 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5ef25e44-78e6-490b-9ef9-eba99d471620 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:59.631519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5ef25e44-78e6-490b-9ef9-eba99d471620 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:16:59.631954 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5ef25e44-78e6-490b-9ef9-eba99d471620 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:16:59.694849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6aa219c5-e82a-42e3-b4b8-14f2ae36053a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:59.702302 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6aa219c5-e82a-42e3-b4b8-14f2ae36053a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1682 microversion: 2.1 time: 0.154650 Jun 16 21:16:59.702864 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 290/626] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:59 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:16:59.763480 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5ef25e44-78e6-490b-9ef9-eba99d471620 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:16:59.771322 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5ef25e44-78e6-490b-9ef9-eba99d471620 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1372 microversion: 2.1 time: 0.152617 Jun 16 21:16:59.771903 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 337/627] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:16:59 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:00.719553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-abf77195-84d3-4003-802f-34ff67628b08 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:00.720341 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-abf77195-84d3-4003-802f-34ff67628b08 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:00.723930 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:00.728075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-abf77195-84d3-4003-802f-34ff67628b08 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:00.728632 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-abf77195-84d3-4003-802f-34ff67628b08 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:00.730093 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-abf77195-84d3-4003-802f-34ff67628b08 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:00.730478 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-abf77195-84d3-4003-802f-34ff67628b08 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:00.788691 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8cc3c2cf-1ccd-4b11-b181-303bd5418fa1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:00.789456 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8cc3c2cf-1ccd-4b11-b181-303bd5418fa1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:00.797282 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8cc3c2cf-1ccd-4b11-b181-303bd5418fa1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:00.797653 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8cc3c2cf-1ccd-4b11-b181-303bd5418fa1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:00.798437 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8cc3c2cf-1ccd-4b11-b181-303bd5418fa1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:00.798875 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8cc3c2cf-1ccd-4b11-b181-303bd5418fa1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:00.806635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-abf77195-84d3-4003-802f-34ff67628b08 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:00.815003 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-abf77195-84d3-4003-802f-34ff67628b08 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 200 len: 1615 microversion: 2.1 time: 0.099488 Jun 16 21:17:00.815822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 291/628] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:00 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 1615 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:00.820337 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:01.029063 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8cc3c2cf-1ccd-4b11-b181-303bd5418fa1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:01.039411 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8cc3c2cf-1ccd-4b11-b181-303bd5418fa1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1566 microversion: 2.1 time: 0.254424 Jun 16 21:17:01.040741 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 338/629] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:00 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1566 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:01.057353 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-70510a65-2425-4138-a9b3-18a9c86f47b3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:01.057931 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-70510a65-2425-4138-a9b3-18a9c86f47b3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:01.063948 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-70510a65-2425-4138-a9b3-18a9c86f47b3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:01.064428 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-70510a65-2425-4138-a9b3-18a9c86f47b3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:01.065201 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-70510a65-2425-4138-a9b3-18a9c86f47b3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:01.065630 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-70510a65-2425-4138-a9b3-18a9c86f47b3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:01.142064 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-5cf3686a-6b4c-4702-9f5d-e798f77eb9e0 req-bd677ee3-9855-4b58-bfc5-605660144d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe2c1e9-e3e7-437a-b627-53fa261bfe2f", "name": "network-vif-deleted", "tag": "6d083cc3-57c5-45ee-8b91-13084586fee3"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:01.153788 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-5cf3686a-6b4c-4702-9f5d-e798f77eb9e0 req-bd677ee3-9855-4b58-bfc5-605660144d0d service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:01.154247 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-5cf3686a-6b4c-4702-9f5d-e798f77eb9e0 req-bd677ee3-9855-4b58-bfc5-605660144d0d service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:01.176390 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-5cf3686a-6b4c-4702-9f5d-e798f77eb9e0 req-bd677ee3-9855-4b58-bfc5-605660144d0d service nova] Creating event network-vif-deleted:6d083cc3-57c5-45ee-8b91-13084586fee3 for instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f on hv-cinder-81914 Jun 16 21:17:01.189516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-5cf3686a-6b4c-4702-9f5d-e798f77eb9e0 req-bd677ee3-9855-4b58-bfc5-605660144d0d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051134 Jun 16 21:17:01.190813 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 339/630] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:17:01.191386 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-70510a65-2425-4138-a9b3-18a9c86f47b3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137880 Jun 16 21:17:01.192119 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 292/631] 10.222.0.43 () {58 vars in 1274 bytes} [Thu Jun 16 21:17:01 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:17:01.839404 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a25882ef-b1a3-44c2-bc8a-fdbf585f3c6b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:01.840389 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a25882ef-b1a3-44c2-bc8a-fdbf585f3c6b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:01.849176 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a25882ef-b1a3-44c2-bc8a-fdbf585f3c6b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:01.850363 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a25882ef-b1a3-44c2-bc8a-fdbf585f3c6b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:01.851423 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a25882ef-b1a3-44c2-bc8a-fdbf585f3c6b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:01.852067 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a25882ef-b1a3-44c2-bc8a-fdbf585f3c6b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:01.880229 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-a25882ef-b1a3-44c2-bc8a-fdbf585f3c6b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] HTTP exception thrown: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a25882ef-b1a3-44c2-bc8a-fdbf585f3c6b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Request method failure captured: Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f HTTP/1.1 Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5znrg1BlivpFkHnanzWccs2prlszc98SqsEUcUzeeIaKSEmJ9fzENTsjOpe5Qk_NQzgYSx59EKzIYY5fjkk4rwfyQQuYnSRsoplrpGBs8lpSHsUHoyoefKGRLOyWSvHcegVce7Q5IbVWJWykg-Seg-ZRUqsFo_eKeCcFzUevqUD7uU Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:17:01.883898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:17:01.886061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f22cbeb1402848dbb84a5718dca357e1"}]}] Jun 16 21:17:01.886061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:17:01.886061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:17:01.886061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:17:01.886061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:17:01.886061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:17:01.886061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:17:01.886061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 2cb12a51b62c48ba95be62f167b7314e Jun 16 21:17:01.886061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:17:01.886061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:17:01.886061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. Jun 16 21:17:01.886061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '7fe2c1e9-e3e7-437a-b627-53fa261bfe2f'} Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:17:01.886832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. Jun 16 21:17:01.888049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:17:01.892673 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a25882ef-b1a3-44c2-bc8a-fdbf585f3c6b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Returning 404 to user: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:17:01.893772 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a25882ef-b1a3-44c2-bc8a-fdbf585f3c6b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 404 len: 111 microversion: 2.1 time: 0.060647 Jun 16 21:17:01.894868 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 340/632] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:01 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:17:01.905564 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6414532f-8bec-4467-89a7-57c782148af7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '.version_select at 0x7fb3f76b4ee0>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:01.927288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6414532f-8bec-4467-89a7-57c782148af7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912746294" status: 202 len: 0 microversion: 2.1 time: 0.027730 Jun 16 21:17:01.929082 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 293/633] 10.222.0.43 () {58 vars in 1220 bytes} [Thu Jun 16 21:17:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912746294 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:17:02.785229 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9156b216-a2fe-4d52-b114-a9949a19d4c0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:02.785986 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-9156b216-a2fe-4d52-b114-a9949a19d4c0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:02.793335 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9156b216-a2fe-4d52-b114-a9949a19d4c0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:02.793899 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9156b216-a2fe-4d52-b114-a9949a19d4c0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:02.794927 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9156b216-a2fe-4d52-b114-a9949a19d4c0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:02.796634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9156b216-a2fe-4d52-b114-a9949a19d4c0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:02.886440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.objects.instance [None req-9156b216-a2fe-4d52-b114-a9949a19d4c0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lazy-loading 'services' on Instance uuid 397f70d9-d52e-42e2-9d9c-a5921d7632a0 {{(pid=117737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:17:02.964223 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9156b216-a2fe-4d52-b114-a9949a19d4c0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "DELETE /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0/os-volume_attachments/dc3bd7af-5846-41c2-a281-2859250c784c" status: 202 len: 0 microversion: 2.1 time: 0.182013 Jun 16 21:17:02.964963 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 341/634] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 16 21:17:02 2022] DELETE /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0/os-volume_attachments/dc3bd7af-5846-41c2-a281-2859250c784c => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:17:02.973246 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7c86aba7-5cce-49cb-8396-ecb5ed71850f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:02.974159 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7c86aba7-5cce-49cb-8396-ecb5ed71850f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:02.983175 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7c86aba7-5cce-49cb-8396-ecb5ed71850f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:02.983618 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7c86aba7-5cce-49cb-8396-ecb5ed71850f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:02.984413 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7c86aba7-5cce-49cb-8396-ecb5ed71850f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:02.984852 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7c86aba7-5cce-49cb-8396-ecb5ed71850f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:03.029197 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7c86aba7-5cce-49cb-8396-ecb5ed71850f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059873 Jun 16 21:17:03.035620 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 294/635] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:17:02 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:17:03.206216 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-a99082ee-e48d-4705-89ee-dc6cf9ed772f req-db25f8d2-be85-4d38-9760-48c7fa4e56e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24b1c256-3ab9-4d48-a2d3-eca09c3159f1", "tag": "05b93a42-bdde-493e-9e4e-b676213111c0"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:03.217632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-a99082ee-e48d-4705-89ee-dc6cf9ed772f req-db25f8d2-be85-4d38-9760-48c7fa4e56e0 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:03.218141 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-a99082ee-e48d-4705-89ee-dc6cf9ed772f req-db25f8d2-be85-4d38-9760-48c7fa4e56e0 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:03.229971 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-a99082ee-e48d-4705-89ee-dc6cf9ed772f req-db25f8d2-be85-4d38-9760-48c7fa4e56e0 service nova] Creating event network-changed:05b93a42-bdde-493e-9e4e-b676213111c0 for instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 on hv-cinder-81914 Jun 16 21:17:03.235853 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-a99082ee-e48d-4705-89ee-dc6cf9ed772f req-db25f8d2-be85-4d38-9760-48c7fa4e56e0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033941 Jun 16 21:17:03.236821 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 342/636] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:17:03.390568 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-bd828cd3-fd78-4516-9302-a8d1cc3ec75d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:03.391190 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-bd828cd3-fd78-4516-9302-a8d1cc3ec75d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:03.397523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bd828cd3-fd78-4516-9302-a8d1cc3ec75d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:03.398075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bd828cd3-fd78-4516-9302-a8d1cc3ec75d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:03.398961 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bd828cd3-fd78-4516-9302-a8d1cc3ec75d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:03.399599 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bd828cd3-fd78-4516-9302-a8d1cc3ec75d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:03.452832 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=100 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:03.530776 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.objects.instance [None req-bd828cd3-fd78-4516-9302-a8d1cc3ec75d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lazy-loading 'services' on Instance uuid 1a0c875b-5859-4684-8846-25255f38cc90 {{(pid=117738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:17:03.651953 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-bd828cd3-fd78-4516-9302-a8d1cc3ec75d tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90/os-volume_attachments/9e14af94-0b00-4ebb-8bbb-5a77641f025a" status: 202 len: 0 microversion: 2.1 time: 0.265784 Jun 16 21:17:03.652689 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 295/637] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 16 21:17:03 2022] DELETE /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90/os-volume_attachments/9e14af94-0b00-4ebb-8bbb-5a77641f025a => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:17:04.042289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ba00aab5-7973-4969-afa0-0231daa249e2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:04.043354 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ba00aab5-7973-4969-afa0-0231daa249e2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:04.049715 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ba00aab5-7973-4969-afa0-0231daa249e2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:04.050153 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ba00aab5-7973-4969-afa0-0231daa249e2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:04.050964 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ba00aab5-7973-4969-afa0-0231daa249e2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:04.051390 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ba00aab5-7973-4969-afa0-0231daa249e2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:04.081044 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ba00aab5-7973-4969-afa0-0231daa249e2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043682 Jun 16 21:17:04.081755 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 343/638] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:17:04 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:17:05.096956 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d341d81c-a771-49ea-b0dc-b6b21cf63867 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:05.098007 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d341d81c-a771-49ea-b0dc-b6b21cf63867 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:05.105465 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d341d81c-a771-49ea-b0dc-b6b21cf63867 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:05.105905 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d341d81c-a771-49ea-b0dc-b6b21cf63867 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:05.106658 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d341d81c-a771-49ea-b0dc-b6b21cf63867 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:05.107088 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d341d81c-a771-49ea-b0dc-b6b21cf63867 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:05.137958 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d341d81c-a771-49ea-b0dc-b6b21cf63867 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046689 Jun 16 21:17:05.138515 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 296/639] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:17:05 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:17:05.815727 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-90e7edd5-7baf-4624-afb2-4976d7abcdd0 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:05.816306 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-90e7edd5-7baf-4624-afb2-4976d7abcdd0 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:05.818748 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:05.825599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-90e7edd5-7baf-4624-afb2-4976d7abcdd0 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:05.826198 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-90e7edd5-7baf-4624-afb2-4976d7abcdd0 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:05.827016 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-90e7edd5-7baf-4624-afb2-4976d7abcdd0 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:05.827510 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-90e7edd5-7baf-4624-afb2-4976d7abcdd0 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:05.853803 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-90e7edd5-7baf-4624-afb2-4976d7abcdd0 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Going to try to terminate instance {{(pid=117737) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:17:05.928895 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-90e7edd5-7baf-4624-afb2-4976d7abcdd0 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 204 len: 0 microversion: 2.1 time: 0.116585 Jun 16 21:17:05.929758 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 344/640] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:17:05 2022] DELETE /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:17:05.939292 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-77385acb-1c8c-473d-a63d-71aea3152707 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:05.939909 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-77385acb-1c8c-473d-a63d-71aea3152707 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:05.945945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-77385acb-1c8c-473d-a63d-71aea3152707 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:05.946388 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-77385acb-1c8c-473d-a63d-71aea3152707 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:05.947203 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-77385acb-1c8c-473d-a63d-71aea3152707 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:05.948273 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-77385acb-1c8c-473d-a63d-71aea3152707 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:06.077081 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-77385acb-1c8c-473d-a63d-71aea3152707 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:06.084469 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-77385acb-1c8c-473d-a63d-71aea3152707 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1514 microversion: 2.1 time: 0.149169 Jun 16 21:17:06.085033 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 297/641] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:05 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:06.149186 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-bdd6746c-a9b2-46d9-952b-84de81686f0c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:06.150174 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-bdd6746c-a9b2-46d9-952b-84de81686f0c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:06.157393 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bdd6746c-a9b2-46d9-952b-84de81686f0c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:06.157836 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bdd6746c-a9b2-46d9-952b-84de81686f0c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:06.158590 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bdd6746c-a9b2-46d9-952b-84de81686f0c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:06.159018 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bdd6746c-a9b2-46d9-952b-84de81686f0c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:06.188127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-bdd6746c-a9b2-46d9-952b-84de81686f0c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043139 Jun 16 21:17:06.188623 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 345/642] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:17:06 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 21:17:06.245328 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0619efe3-97dc-4bd6-b1a8-f845928f060f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:06.245835 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0619efe3-97dc-4bd6-b1a8-f845928f060f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:06.251706 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0619efe3-97dc-4bd6-b1a8-f845928f060f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:06.252145 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0619efe3-97dc-4bd6-b1a8-f845928f060f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:06.252939 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0619efe3-97dc-4bd6-b1a8-f845928f060f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:06.253369 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0619efe3-97dc-4bd6-b1a8-f845928f060f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:06.279381 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0619efe3-97dc-4bd6-b1a8-f845928f060f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Going to try to terminate instance {{(pid=117738) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:17:06.358812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0619efe3-97dc-4bd6-b1a8-f845928f060f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "DELETE /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 204 len: 0 microversion: 2.1 time: 0.117603 Jun 16 21:17:06.362636 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 298/643] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:17:06 2022] DELETE /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 21:17:06.367695 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a4231e38-ffe7-47cb-ab45-c8fc553481e9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:06.368329 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a4231e38-ffe7-47cb-ab45-c8fc553481e9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:06.374331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a4231e38-ffe7-47cb-ab45-c8fc553481e9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:06.374770 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a4231e38-ffe7-47cb-ab45-c8fc553481e9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:06.375515 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a4231e38-ffe7-47cb-ab45-c8fc553481e9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:06.375941 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a4231e38-ffe7-47cb-ab45-c8fc553481e9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:06.508626 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a4231e38-ffe7-47cb-ab45-c8fc553481e9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:06.516869 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a4231e38-ffe7-47cb-ab45-c8fc553481e9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1682 microversion: 2.1 time: 0.153152 Jun 16 21:17:06.517421 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 346/644] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:06 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:07.102646 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0957a29c-d6df-4fe7-b2c4-ff4b4f10ec08 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:07.103342 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0957a29c-d6df-4fe7-b2c4-ff4b4f10ec08 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:07.110701 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0957a29c-d6df-4fe7-b2c4-ff4b4f10ec08 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:07.111148 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0957a29c-d6df-4fe7-b2c4-ff4b4f10ec08 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:07.111915 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0957a29c-d6df-4fe7-b2c4-ff4b4f10ec08 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:07.112389 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0957a29c-d6df-4fe7-b2c4-ff4b4f10ec08 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:07.246487 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0957a29c-d6df-4fe7-b2c4-ff4b4f10ec08 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:07.253889 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0957a29c-d6df-4fe7-b2c4-ff4b4f10ec08 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1514 microversion: 2.1 time: 0.155410 Jun 16 21:17:07.254454 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 299/645] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:07 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:07.535817 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d2e37aba-9c08-46c5-9f67-de0bc03c03b1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:07.536416 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d2e37aba-9c08-46c5-9f67-de0bc03c03b1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:07.543693 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d2e37aba-9c08-46c5-9f67-de0bc03c03b1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:07.544126 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d2e37aba-9c08-46c5-9f67-de0bc03c03b1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:07.544905 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d2e37aba-9c08-46c5-9f67-de0bc03c03b1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:07.545329 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d2e37aba-9c08-46c5-9f67-de0bc03c03b1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:07.674036 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d2e37aba-9c08-46c5-9f67-de0bc03c03b1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:07.682236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d2e37aba-9c08-46c5-9f67-de0bc03c03b1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1682 microversion: 2.1 time: 0.149971 Jun 16 21:17:07.682865 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 347/646] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:07 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:08.271565 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6270d8de-fed7-4261-bbfe-2e9dc51c208e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:08.272193 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6270d8de-fed7-4261-bbfe-2e9dc51c208e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:08.278664 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6270d8de-fed7-4261-bbfe-2e9dc51c208e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:08.279120 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6270d8de-fed7-4261-bbfe-2e9dc51c208e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:08.279866 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6270d8de-fed7-4261-bbfe-2e9dc51c208e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:08.280324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6270d8de-fed7-4261-bbfe-2e9dc51c208e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:08.413389 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6270d8de-fed7-4261-bbfe-2e9dc51c208e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:08.420915 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6270d8de-fed7-4261-bbfe-2e9dc51c208e tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1514 microversion: 2.1 time: 0.153532 Jun 16 21:17:08.421479 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 300/647] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:08 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:08.699451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a520350a-9991-4a1a-a41c-b3dc3ea2aff9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:08.700060 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a520350a-9991-4a1a-a41c-b3dc3ea2aff9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:08.706557 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a520350a-9991-4a1a-a41c-b3dc3ea2aff9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:08.706996 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a520350a-9991-4a1a-a41c-b3dc3ea2aff9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:08.707751 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a520350a-9991-4a1a-a41c-b3dc3ea2aff9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:08.708199 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a520350a-9991-4a1a-a41c-b3dc3ea2aff9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:08.840382 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a520350a-9991-4a1a-a41c-b3dc3ea2aff9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:08.847697 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a520350a-9991-4a1a-a41c-b3dc3ea2aff9 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1682 microversion: 2.1 time: 0.152735 Jun 16 21:17:08.848270 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 348/648] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:08 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:09.437715 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b4a62d1a-63aa-4691-b00c-eb24a41aab10 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:09.438325 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b4a62d1a-63aa-4691-b00c-eb24a41aab10 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:09.444766 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b4a62d1a-63aa-4691-b00c-eb24a41aab10 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:09.445208 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b4a62d1a-63aa-4691-b00c-eb24a41aab10 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:09.445960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b4a62d1a-63aa-4691-b00c-eb24a41aab10 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:09.446392 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b4a62d1a-63aa-4691-b00c-eb24a41aab10 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:09.574713 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b4a62d1a-63aa-4691-b00c-eb24a41aab10 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:09.582572 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b4a62d1a-63aa-4691-b00c-eb24a41aab10 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1514 microversion: 2.1 time: 0.148670 Jun 16 21:17:09.583162 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 301/649] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:09 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:09.865036 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8beda26b-7f99-4948-a519-53f1d88a96b0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:09.865671 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8beda26b-7f99-4948-a519-53f1d88a96b0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:09.872284 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8beda26b-7f99-4948-a519-53f1d88a96b0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:09.872728 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8beda26b-7f99-4948-a519-53f1d88a96b0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:09.873484 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8beda26b-7f99-4948-a519-53f1d88a96b0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:09.873913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8beda26b-7f99-4948-a519-53f1d88a96b0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:09.999857 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8beda26b-7f99-4948-a519-53f1d88a96b0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:10.008482 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8beda26b-7f99-4948-a519-53f1d88a96b0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1682 microversion: 2.1 time: 0.147163 Jun 16 21:17:10.009046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 349/650] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:09 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:10.605226 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b1b5a2dc-e1e0-4ebb-8848-eda6f8e58d89 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:10.605878 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b1b5a2dc-e1e0-4ebb-8848-eda6f8e58d89 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:10.612672 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b1b5a2dc-e1e0-4ebb-8848-eda6f8e58d89 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:10.613118 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b1b5a2dc-e1e0-4ebb-8848-eda6f8e58d89 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:10.614104 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b1b5a2dc-e1e0-4ebb-8848-eda6f8e58d89 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:10.614536 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b1b5a2dc-e1e0-4ebb-8848-eda6f8e58d89 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:10.751216 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b1b5a2dc-e1e0-4ebb-8848-eda6f8e58d89 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:10.759039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b1b5a2dc-e1e0-4ebb-8848-eda6f8e58d89 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1514 microversion: 2.1 time: 0.163360 Jun 16 21:17:10.759611 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 302/651] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:10 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:11.027220 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-db301daa-8015-4ab4-9fdc-355412c64ea6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:11.027769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-db301daa-8015-4ab4-9fdc-355412c64ea6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:11.036637 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-db301daa-8015-4ab4-9fdc-355412c64ea6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:11.037083 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-db301daa-8015-4ab4-9fdc-355412c64ea6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:11.037865 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-db301daa-8015-4ab4-9fdc-355412c64ea6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:11.038300 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-db301daa-8015-4ab4-9fdc-355412c64ea6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:11.513014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-750bd4ab-fb3f-412e-a2a7-8c3b701fc064 req-ac795d61-f96e-49b1-b0e4-d5ec9c6d4720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0c875b-5859-4684-8846-25255f38cc90", "name": "network-vif-deleted", "tag": "0bea97fe-a1f6-4344-b4a0-a56b13b5543c"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:11.523982 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-750bd4ab-fb3f-412e-a2a7-8c3b701fc064 req-ac795d61-f96e-49b1-b0e4-d5ec9c6d4720 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:11.524544 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-750bd4ab-fb3f-412e-a2a7-8c3b701fc064 req-ac795d61-f96e-49b1-b0e4-d5ec9c6d4720 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:11.536911 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-750bd4ab-fb3f-412e-a2a7-8c3b701fc064 req-ac795d61-f96e-49b1-b0e4-d5ec9c6d4720 service nova] Creating event network-vif-deleted:0bea97fe-a1f6-4344-b4a0-a56b13b5543c for instance 1a0c875b-5859-4684-8846-25255f38cc90 on hv-cinder-81914 Jun 16 21:17:11.543831 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-750bd4ab-fb3f-412e-a2a7-8c3b701fc064 req-ac795d61-f96e-49b1-b0e4-d5ec9c6d4720 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035461 Jun 16 21:17:11.544571 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 303/652] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:17:11.571165 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-db301daa-8015-4ab4-9fdc-355412c64ea6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:11.580871 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-db301daa-8015-4ab4-9fdc-355412c64ea6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1682 microversion: 2.1 time: 0.558246 Jun 16 21:17:11.592202 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 350/653] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:11 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1682 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:11.776744 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-54daafcd-6b01-40cc-ac24-3ef39da4954a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:11.777417 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-54daafcd-6b01-40cc-ac24-3ef39da4954a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:11.784424 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-54daafcd-6b01-40cc-ac24-3ef39da4954a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:11.784868 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-54daafcd-6b01-40cc-ac24-3ef39da4954a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:11.785690 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-54daafcd-6b01-40cc-ac24-3ef39da4954a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:11.786122 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-54daafcd-6b01-40cc-ac24-3ef39da4954a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:11.817070 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-54daafcd-6b01-40cc-ac24-3ef39da4954a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:11.817503 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-54daafcd-6b01-40cc-ac24-3ef39da4954a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:11.817941 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.objects.instance [None req-54daafcd-6b01-40cc-ac24-3ef39da4954a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lazy-loading 'fault' on Instance uuid 1a0c875b-5859-4684-8846-25255f38cc90 {{(pid=117738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:17:11.862659 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-54daafcd-6b01-40cc-ac24-3ef39da4954a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1d69a29709455d9d9dc596ecbb870d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a667c6d13514cc4bdaaf4598bc723d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:11.871021 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-54daafcd-6b01-40cc-ac24-3ef39da4954a tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 200 len: 1309 microversion: 2.1 time: 0.098738 Jun 16 21:17:11.871587 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 304/654] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:11 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:12.600764 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e038069e-c3ea-404b-a534-58c61778f0bb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:12.602030 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e038069e-c3ea-404b-a534-58c61778f0bb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:12.611974 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e038069e-c3ea-404b-a534-58c61778f0bb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:12.612453 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e038069e-c3ea-404b-a534-58c61778f0bb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:12.614245 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e038069e-c3ea-404b-a534-58c61778f0bb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:12.615171 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e038069e-c3ea-404b-a534-58c61778f0bb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:12.651820 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e038069e-c3ea-404b-a534-58c61778f0bb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:12.652763 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e038069e-c3ea-404b-a534-58c61778f0bb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:12.653528 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.objects.instance [None req-e038069e-c3ea-404b-a534-58c61778f0bb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lazy-loading 'fault' on Instance uuid 397f70d9-d52e-42e2-9d9c-a5921d7632a0 {{(pid=117737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:17:12.699410 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e038069e-c3ea-404b-a534-58c61778f0bb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:12.706699 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e038069e-c3ea-404b-a534-58c61778f0bb tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 200 len: 1331 microversion: 2.1 time: 0.111062 Jun 16 21:17:12.707261 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 351/655] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:12 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:12.888742 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2217d8f4-0af4-4b5b-8b9e-a64077510d44 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:12.889355 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2217d8f4-0af4-4b5b-8b9e-a64077510d44 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] [instance: 1a0c875b-5859-4684-8846-25255f38cc90] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:12.895791 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2217d8f4-0af4-4b5b-8b9e-a64077510d44 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:12.896264 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2217d8f4-0af4-4b5b-8b9e-a64077510d44 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:12.897026 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2217d8f4-0af4-4b5b-8b9e-a64077510d44 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:12.897459 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2217d8f4-0af4-4b5b-8b9e-a64077510d44 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:12.910752 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-2217d8f4-0af4-4b5b-8b9e-a64077510d44 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] HTTP exception thrown: Instance 1a0c875b-5859-4684-8846-25255f38cc90 could not be found. Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2217d8f4-0af4-4b5b-8b9e-a64077510d44 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Request method failure captured: Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 HTTP/1.1 Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq50tFRUmFNsVSBR2vfMPs79UxDXGMhq9P5CN_v0QkV6PXJh1sOtnGfUgWEPWIz_GxFx8Dizyq2p3AynUMplSq-VTXmNDEsGY3TLPznJNy630a9cJoz_Sz4GVrvp84BOV5VCdG4FXCzL-nL0pi0LyUEOdCRybudgHKqIne0_EC2IDyFo Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 0a667c6d13514cc4bdaaf4598bc723d4 Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-VolumesSnapshotTestJSON-81585281 Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:17:12.912415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:17:12.913951 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0a667c6d13514cc4bdaaf4598bc723d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0a667c6d13514cc4bdaaf4598bc723d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0a667c6d13514cc4bdaaf4598bc723d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0a667c6d13514cc4bdaaf4598bc723d4"}]}] Jun 16 21:17:12.913951 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-VolumesSnapshotTestJSON-81585281 Jun 16 21:17:12.913951 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 0a667c6d13514cc4bdaaf4598bc723d4 Jun 16 21:17:12.913951 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-81585281 Jun 16 21:17:12.913951 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-VolumesSnapshotTestJSON-81585281-project Jun 16 21:17:12.913951 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:17:12.913951 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:17:12.913951 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 2d1d69a29709455d9d9dc596ecbb870d Jun 16 21:17:12.913951 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-VolumesSnapshotTestJSON-81585281-project Jun 16 21:17:12.913951 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:17:12.913951 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 1a0c875b-5859-4684-8846-25255f38cc90 could not be found. Jun 16 21:17:12.913951 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '1a0c875b-5859-4684-8846-25255f38cc90'} Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a0c875b-5859-4684-8846-25255f38cc90 could not be found. Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:17:12.914770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a0c875b-5859-4684-8846-25255f38cc90 could not be found. Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a0c875b-5859-4684-8846-25255f38cc90 could not be found. Jun 16 21:17:12.916676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:17:12.917775 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2217d8f4-0af4-4b5b-8b9e-a64077510d44 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] Returning 404 to user: Instance 1a0c875b-5859-4684-8846-25255f38cc90 could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:17:12.917775 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2217d8f4-0af4-4b5b-8b9e-a64077510d44 tempest-VolumesSnapshotTestJSON-81585281 tempest-VolumesSnapshotTestJSON-81585281-project] 10.222.0.43 "GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90" status: 404 len: 111 microversion: 2.1 time: 0.029576 Jun 16 21:17:12.917775 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 305/656] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:12 2022] GET /compute/v2.1/servers/1a0c875b-5859-4684-8846-25255f38cc90 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:17:13.562243 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-3ffd8346-93a3-41cc-9a36-0e7d48393979 req-4f553e32-3741-43b3-9f04-3d2e8c9d208f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397f70d9-d52e-42e2-9d9c-a5921d7632a0", "name": "network-vif-deleted", "tag": "b0b64745-4342-4163-bc5d-724401da0c19"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:13.570312 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-3ffd8346-93a3-41cc-9a36-0e7d48393979 req-4f553e32-3741-43b3-9f04-3d2e8c9d208f service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:13.570751 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-3ffd8346-93a3-41cc-9a36-0e7d48393979 req-4f553e32-3741-43b3-9f04-3d2e8c9d208f service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:13.582061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-3ffd8346-93a3-41cc-9a36-0e7d48393979 req-4f553e32-3741-43b3-9f04-3d2e8c9d208f service nova] Creating event network-vif-deleted:b0b64745-4342-4163-bc5d-724401da0c19 for instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 on hv-cinder-81914 Jun 16 21:17:13.586791 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-3ffd8346-93a3-41cc-9a36-0e7d48393979 req-4f553e32-3741-43b3-9f04-3d2e8c9d208f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028404 Jun 16 21:17:13.587400 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 352/657] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:17:13.724324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-e3eeb247-079b-42a8-b67d-dafaf2a18934 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:13.724960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-e3eeb247-079b-42a8-b67d-dafaf2a18934 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:13.732108 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e3eeb247-079b-42a8-b67d-dafaf2a18934 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:13.732580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e3eeb247-079b-42a8-b67d-dafaf2a18934 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:13.733336 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e3eeb247-079b-42a8-b67d-dafaf2a18934 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:13.735788 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e3eeb247-079b-42a8-b67d-dafaf2a18934 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:13.750904 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-e3eeb247-079b-42a8-b67d-dafaf2a18934 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] HTTP exception thrown: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-e3eeb247-079b-42a8-b67d-dafaf2a18934 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Request method failure captured: Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 HTTP/1.1 Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq5znrg1BlivpFkHnanzWccs2prlszc98SqsEUcUzeeIaKSEmJ9fzENTsjOpe5Qk_NQzgYSx59EKzIYY5fjkk4rwfyQQuYnSRsoplrpGBs8lpSHsUHoyoefKGRLOyWSvHcegVce7Q5IbVWJWykg-Seg-ZRUqsFo_eKeCcFzUevqUD7uU Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:17:13.752473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:17:13.753977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f22cbeb1402848dbb84a5718dca357e1"}]}] Jun 16 21:17:13.753977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:17:13.753977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:17:13.753977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:17:13.753977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:17:13.753977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:17:13.753977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:17:13.753977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 2cb12a51b62c48ba95be62f167b7314e Jun 16 21:17:13.753977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:17:13.753977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:17:13.753977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. Jun 16 21:17:13.753977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '397f70d9-d52e-42e2-9d9c-a5921d7632a0'} Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:17:13.754779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. Jun 16 21:17:13.755945 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:17:13.757033 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-e3eeb247-079b-42a8-b67d-dafaf2a18934 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Returning 404 to user: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:17:13.757033 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-e3eeb247-079b-42a8-b67d-dafaf2a18934 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 404 len: 111 microversion: 2.1 time: 0.033438 Jun 16 21:17:13.757033 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 306/658] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:13 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:17:13.764609 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-46a19556-8798-43e8-99ec-4cd68501b183 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '.version_select at 0x7fb3f765d940>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:13.782961 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-46a19556-8798-43e8-99ec-4cd68501b183 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-332938601" status: 202 len: 0 microversion: 2.1 time: 0.023928 Jun 16 21:17:13.783522 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 353/659] 10.222.0.43 () {58 vars in 1217 bytes} [Thu Jun 16 21:17:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-332938601 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:17:14.422861 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-362b8434-7d92-42e4-aa7d-4b8595dc8bf3 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Action: 'create', calling method: .version_select at 0x7fb3f75a6f70>, body: {"keypair": {"name": "tempest-keypair-900089757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/WxW/mw1yMzAu2ug9eNqRfp2pyzuTvmXVsMf3uTi21fuDKu3GGLsWozHsCQdkELXDpsGDjZ07h80N09/8huNmNQZNQF2ePPhvcYH7qCN/yUFLK8/NdCxZBEclpQVKuAw=="}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:14.439456 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-362b8434-7d92-42e4-aa7d-4b8595dc8bf3 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Getting quotas for project f22cbeb1402848dbb84a5718dca357e1. Resources: {'key_pairs'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:17:14.443219 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-362b8434-7d92-42e4-aa7d-4b8595dc8bf3 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Getting quotas for user 2cb12a51b62c48ba95be62f167b7314e and project f22cbeb1402848dbb84a5718dca357e1. Resources: {'key_pairs'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:17:14.465582 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-362b8434-7d92-42e4-aa7d-4b8595dc8bf3 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046501 Jun 16 21:17:14.466191 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 307/660] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 16 21:17:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:17:15.741359 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-022672a3-0a28-4dfc-b15f-214b7cf6c26c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-454192968", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4d0a869-8cad-4582-83ab-86c097e04c69"}], "security_groups": [{"name": "tempest-securitygroup--423056898"}], "key_name": "tempest-keypair-900089757", "user_data": "}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:15.842396 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.network.neutron [None req-022672a3-0a28-4dfc-b15f-214b7cf6c26c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] validate_networks() for [('c4d0a869-8cad-4582-83ab-86c097e04c69', None, None, None, None, None)] {{(pid=117737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:17:16.211212 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-022672a3-0a28-4dfc-b15f-214b7cf6c26c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Flavor limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:17:16.211624 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-022672a3-0a28-4dfc-b15f-214b7cf6c26c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Image limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:17:16.212086 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-022672a3-0a28-4dfc-b15f-214b7cf6c26c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Flavor pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:17:16.212517 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-022672a3-0a28-4dfc-b15f-214b7cf6c26c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Image pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:17:16.212922 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-022672a3-0a28-4dfc-b15f-214b7cf6c26c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:17:16.222153 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-022672a3-0a28-4dfc-b15f-214b7cf6c26c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:16.222589 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-022672a3-0a28-4dfc-b15f-214b7cf6c26c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:16.223369 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-022672a3-0a28-4dfc-b15f-214b7cf6c26c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:16.223793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-022672a3-0a28-4dfc-b15f-214b7cf6c26c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:16.239745 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-022672a3-0a28-4dfc-b15f-214b7cf6c26c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Getting quotas for project f22cbeb1402848dbb84a5718dca357e1. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:17:16.243882 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-022672a3-0a28-4dfc-b15f-214b7cf6c26c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Getting quotas for user 2cb12a51b62c48ba95be62f167b7314e and project f22cbeb1402848dbb84a5718dca357e1. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:17:16.254772 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-022672a3-0a28-4dfc-b15f-214b7cf6c26c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Going to run 1 instances... {{(pid=117737) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:17:16.257094 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-022672a3-0a28-4dfc-b15f-214b7cf6c26c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:17:16.305726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-022672a3-0a28-4dfc-b15f-214b7cf6c26c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.569499 Jun 16 21:17:16.306368 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 354/661] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:17:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:17:16.316826 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-09e52d3a-e5b4-43a5-ac3a-59c5a777916d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:16.317587 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-09e52d3a-e5b4-43a5-ac3a-59c5a777916d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:16.377554 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-09e52d3a-e5b4-43a5-ac3a-59c5a777916d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:16.384165 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-09e52d3a-e5b4-43a5-ac3a-59c5a777916d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 200 len: 1240 microversion: 2.1 time: 0.071723 Jun 16 21:17:16.384857 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 308/662] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:16 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:16.629788 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e40c526a-e1de-4c02-af49-53ab20de0ccd tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:16.630999 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e40c526a-e1de-4c02-af49-53ab20de0ccd tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:16.638223 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e40c526a-e1de-4c02-af49-53ab20de0ccd tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:16.638669 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e40c526a-e1de-4c02-af49-53ab20de0ccd tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:16.639431 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e40c526a-e1de-4c02-af49-53ab20de0ccd tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:16.639862 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e40c526a-e1de-4c02-af49-53ab20de0ccd tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:16.705165 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:16.717109 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e40c526a-e1de-4c02-af49-53ab20de0ccd tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "POST /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/action" status: 202 len: 0 microversion: 2.1 time: 0.091040 Jun 16 21:17:16.717747 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 355/663] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 16 21:17:16 2022] POST /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 21:17:16.725696 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-942f88ac-0bb0-40d8-af01-4dc5b65e9903 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:16.726300 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-942f88ac-0bb0-40d8-af01-4dc5b65e9903 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:16.733210 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-942f88ac-0bb0-40d8-af01-4dc5b65e9903 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:16.733649 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-942f88ac-0bb0-40d8-af01-4dc5b65e9903 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:16.734404 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-942f88ac-0bb0-40d8-af01-4dc5b65e9903 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:16.734837 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-942f88ac-0bb0-40d8-af01-4dc5b65e9903 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:16.879300 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-942f88ac-0bb0-40d8-af01-4dc5b65e9903 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:16.888122 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-942f88ac-0bb0-40d8-af01-4dc5b65e9903 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1752 microversion: 2.1 time: 0.166284 Jun 16 21:17:16.888813 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 309/664] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:16 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:17.403165 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-cb8fa1dd-c769-466d-b922-52973c2585a0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:17.403856 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-cb8fa1dd-c769-466d-b922-52973c2585a0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:17.410503 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cb8fa1dd-c769-466d-b922-52973c2585a0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:17.410944 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cb8fa1dd-c769-466d-b922-52973c2585a0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:17.411718 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cb8fa1dd-c769-466d-b922-52973c2585a0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:17.412157 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cb8fa1dd-c769-466d-b922-52973c2585a0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:17.492714 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-cb8fa1dd-c769-466d-b922-52973c2585a0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:17.500783 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-cb8fa1dd-c769-466d-b922-52973c2585a0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 200 len: 1236 microversion: 2.1 time: 0.102727 Jun 16 21:17:17.501340 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 356/665] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:17 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 1236 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:17.905731 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d3165cec-233f-4c9f-8bce-7fb92a9b0a85 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:17.906513 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d3165cec-233f-4c9f-8bce-7fb92a9b0a85 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:17.915315 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d3165cec-233f-4c9f-8bce-7fb92a9b0a85 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:17.915768 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d3165cec-233f-4c9f-8bce-7fb92a9b0a85 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:17.917207 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d3165cec-233f-4c9f-8bce-7fb92a9b0a85 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:17.917640 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d3165cec-233f-4c9f-8bce-7fb92a9b0a85 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:18.079407 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d3165cec-233f-4c9f-8bce-7fb92a9b0a85 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:18.090420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d3165cec-233f-4c9f-8bce-7fb92a9b0a85 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1752 microversion: 2.1 time: 0.188502 Jun 16 21:17:18.091397 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 310/666] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:17 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1752 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:18.518200 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-82dbc5d4-6ea1-4e4d-8af2-69f8dfaa8b2f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:18.519549 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-82dbc5d4-6ea1-4e4d-8af2-69f8dfaa8b2f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:18.527779 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-82dbc5d4-6ea1-4e4d-8af2-69f8dfaa8b2f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:18.528692 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-82dbc5d4-6ea1-4e4d-8af2-69f8dfaa8b2f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:18.529873 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-82dbc5d4-6ea1-4e4d-8af2-69f8dfaa8b2f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:18.530311 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-82dbc5d4-6ea1-4e4d-8af2-69f8dfaa8b2f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:18.625193 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-82dbc5d4-6ea1-4e4d-8af2-69f8dfaa8b2f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:18.632984 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-82dbc5d4-6ea1-4e4d-8af2-69f8dfaa8b2f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 200 len: 1298 microversion: 2.1 time: 0.118759 Jun 16 21:17:18.633651 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 357/667] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:18 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:19.107478 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-de7ea4a2-9b8f-44e4-b658-ce06d16a4bd7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:19.108220 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-de7ea4a2-9b8f-44e4-b658-ce06d16a4bd7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:19.115831 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-de7ea4a2-9b8f-44e4-b658-ce06d16a4bd7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:19.116549 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-de7ea4a2-9b8f-44e4-b658-ce06d16a4bd7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:19.117378 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-de7ea4a2-9b8f-44e4-b658-ce06d16a4bd7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:19.117983 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-de7ea4a2-9b8f-44e4-b658-ce06d16a4bd7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:19.270352 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-de7ea4a2-9b8f-44e4-b658-ce06d16a4bd7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:19.278403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-de7ea4a2-9b8f-44e4-b658-ce06d16a4bd7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.175373 Jun 16 21:17:19.278974 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 311/668] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:19 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:19.649131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-cb1484ed-0cc8-46cf-831a-67392ba22727 req-f612d3d4-cc57-4ad6-b09a-a85cccb56716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea6b530-d41f-4b72-af93-e2cdb36addba", "tag": "fb676485-af3b-4d79-a796-74cac7d6e1ee"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:19.654128 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6f743abc-504c-4497-a5d2-6669b22ea172 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:19.655734 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6f743abc-504c-4497-a5d2-6669b22ea172 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:19.663493 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-cb1484ed-0cc8-46cf-831a-67392ba22727 req-f612d3d4-cc57-4ad6-b09a-a85cccb56716 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:19.663983 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-cb1484ed-0cc8-46cf-831a-67392ba22727 req-f612d3d4-cc57-4ad6-b09a-a85cccb56716 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:19.665996 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6f743abc-504c-4497-a5d2-6669b22ea172 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:19.666787 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6f743abc-504c-4497-a5d2-6669b22ea172 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:19.668930 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6f743abc-504c-4497-a5d2-6669b22ea172 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:19.669639 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6f743abc-504c-4497-a5d2-6669b22ea172 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:19.676943 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-cb1484ed-0cc8-46cf-831a-67392ba22727 req-f612d3d4-cc57-4ad6-b09a-a85cccb56716 service nova] Creating event network-changed:fb676485-af3b-4d79-a796-74cac7d6e1ee for instance 5ea6b530-d41f-4b72-af93-e2cdb36addba on hv-cinder-81914 Jun 16 21:17:19.683476 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-cb1484ed-0cc8-46cf-831a-67392ba22727 req-f612d3d4-cc57-4ad6-b09a-a85cccb56716 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038273 Jun 16 21:17:19.684837 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 358/669] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:17:19.841107 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6f743abc-504c-4497-a5d2-6669b22ea172 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:19.848559 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6f743abc-504c-4497-a5d2-6669b22ea172 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 200 len: 1365 microversion: 2.1 time: 0.200823 Jun 16 21:17:19.849117 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 312/670] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:19 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:20.296133 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5cde7425-909a-4c6d-b666-de0c5e94d276 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:20.296865 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5cde7425-909a-4c6d-b666-de0c5e94d276 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:20.302946 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5cde7425-909a-4c6d-b666-de0c5e94d276 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:20.303756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5cde7425-909a-4c6d-b666-de0c5e94d276 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:20.304713 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5cde7425-909a-4c6d-b666-de0c5e94d276 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:20.305189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5cde7425-909a-4c6d-b666-de0c5e94d276 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:20.455398 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5cde7425-909a-4c6d-b666-de0c5e94d276 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:20.463840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5cde7425-909a-4c6d-b666-de0c5e94d276 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.171760 Jun 16 21:17:20.464451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 359/671] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:20 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:20.866051 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a25a0138-a358-46e6-95cf-c7be183b4a05 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:20.866580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a25a0138-a358-46e6-95cf-c7be183b4a05 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:20.873671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a25a0138-a358-46e6-95cf-c7be183b4a05 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:20.874111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a25a0138-a358-46e6-95cf-c7be183b4a05 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:20.874898 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a25a0138-a358-46e6-95cf-c7be183b4a05 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:20.875329 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a25a0138-a358-46e6-95cf-c7be183b4a05 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:20.889903 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:21.003341 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a25a0138-a358-46e6-95cf-c7be183b4a05 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:21.010725 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a25a0138-a358-46e6-95cf-c7be183b4a05 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 200 len: 1365 microversion: 2.1 time: 0.148811 Jun 16 21:17:21.011284 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 313/672] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:20 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:21.481535 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-063c6680-5374-4074-a5c2-417f94c5f990 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:21.482151 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-063c6680-5374-4074-a5c2-417f94c5f990 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:21.488887 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-063c6680-5374-4074-a5c2-417f94c5f990 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:21.489446 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-063c6680-5374-4074-a5c2-417f94c5f990 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:21.490822 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-063c6680-5374-4074-a5c2-417f94c5f990 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:21.491322 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-063c6680-5374-4074-a5c2-417f94c5f990 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:21.728240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-063c6680-5374-4074-a5c2-417f94c5f990 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:21.737339 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-063c6680-5374-4074-a5c2-417f94c5f990 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.260294 Jun 16 21:17:21.737903 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 360/673] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:21 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:22.027838 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d7a6ad3a-57fd-4eec-9c88-3ba8b93c1c48 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:22.029096 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d7a6ad3a-57fd-4eec-9c88-3ba8b93c1c48 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:22.036613 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d7a6ad3a-57fd-4eec-9c88-3ba8b93c1c48 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:22.037485 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d7a6ad3a-57fd-4eec-9c88-3ba8b93c1c48 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:22.038260 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d7a6ad3a-57fd-4eec-9c88-3ba8b93c1c48 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:22.038696 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d7a6ad3a-57fd-4eec-9c88-3ba8b93c1c48 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:22.173285 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d7a6ad3a-57fd-4eec-9c88-3ba8b93c1c48 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:22.180755 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d7a6ad3a-57fd-4eec-9c88-3ba8b93c1c48 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 200 len: 1365 microversion: 2.1 time: 0.157774 Jun 16 21:17:22.181323 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 314/674] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:22 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:22.754863 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-bcefe3ed-ad98-4c6b-8c4f-42e7e623125d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:22.755388 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-bcefe3ed-ad98-4c6b-8c4f-42e7e623125d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:22.762471 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bcefe3ed-ad98-4c6b-8c4f-42e7e623125d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:22.762916 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bcefe3ed-ad98-4c6b-8c4f-42e7e623125d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:22.763668 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bcefe3ed-ad98-4c6b-8c4f-42e7e623125d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:22.764101 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bcefe3ed-ad98-4c6b-8c4f-42e7e623125d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:22.908107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bcefe3ed-ad98-4c6b-8c4f-42e7e623125d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:22.915995 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-bcefe3ed-ad98-4c6b-8c4f-42e7e623125d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.165118 Jun 16 21:17:22.917100 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 361/675] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:22 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:23.197634 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d2d07f4a-d5ac-406c-84f8-29e87b52cd94 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:23.198339 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d2d07f4a-d5ac-406c-84f8-29e87b52cd94 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:23.205030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d2d07f4a-d5ac-406c-84f8-29e87b52cd94 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:23.205465 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d2d07f4a-d5ac-406c-84f8-29e87b52cd94 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:23.206216 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d2d07f4a-d5ac-406c-84f8-29e87b52cd94 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:23.206641 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d2d07f4a-d5ac-406c-84f8-29e87b52cd94 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:23.342953 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d2d07f4a-d5ac-406c-84f8-29e87b52cd94 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:23.350230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d2d07f4a-d5ac-406c-84f8-29e87b52cd94 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 200 len: 1365 microversion: 2.1 time: 0.156591 Jun 16 21:17:23.350792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 315/676] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:23 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:23.711355 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-acb1e532-f86b-42da-91cc-aab8a81f5cbb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:23.711878 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-acb1e532-f86b-42da-91cc-aab8a81f5cbb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:23.718567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-acb1e532-f86b-42da-91cc-aab8a81f5cbb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:23.719006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-acb1e532-f86b-42da-91cc-aab8a81f5cbb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:23.719749 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-acb1e532-f86b-42da-91cc-aab8a81f5cbb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:23.720200 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-acb1e532-f86b-42da-91cc-aab8a81f5cbb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:23.746176 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.objects.instance [None req-acb1e532-f86b-42da-91cc-aab8a81f5cbb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lazy-loading 'flavor' on Instance uuid 329313fc-d559-41c6-9dad-471e57c9751e {{(pid=117737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:17:23.816987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-acb1e532-f86b-42da-91cc-aab8a81f5cbb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "POST /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e/action" status: 202 len: 0 microversion: 2.1 time: 0.109301 Jun 16 21:17:23.817682 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 362/677] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 16 21:17:23 2022] POST /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:17:23.826212 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5742ca77-50c8-42a4-8d7c-7ef8a8dc91bf tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:23.826840 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5742ca77-50c8-42a4-8d7c-7ef8a8dc91bf tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:23.832865 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5742ca77-50c8-42a4-8d7c-7ef8a8dc91bf tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:23.833307 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5742ca77-50c8-42a4-8d7c-7ef8a8dc91bf tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:23.834065 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5742ca77-50c8-42a4-8d7c-7ef8a8dc91bf tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:23.834495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5742ca77-50c8-42a4-8d7c-7ef8a8dc91bf tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:23.934111 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f8a32d8b-8603-4e8a-92e7-fd281aee0c28 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:23.934815 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f8a32d8b-8603-4e8a-92e7-fd281aee0c28 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:23.941216 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f8a32d8b-8603-4e8a-92e7-fd281aee0c28 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:23.941657 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f8a32d8b-8603-4e8a-92e7-fd281aee0c28 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:23.942431 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f8a32d8b-8603-4e8a-92e7-fd281aee0c28 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:23.942891 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f8a32d8b-8603-4e8a-92e7-fd281aee0c28 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:23.975028 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5742ca77-50c8-42a4-8d7c-7ef8a8dc91bf tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:23.987020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5742ca77-50c8-42a4-8d7c-7ef8a8dc91bf tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.164990 Jun 16 21:17:23.990581 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 316/678] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:23 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:24.104648 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f8a32d8b-8603-4e8a-92e7-fd281aee0c28 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:24.111385 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-8f967a00-a56e-4a12-ac7c-685715dc28c1 req-7b65618f-0c23-4a49-baa0-ce3c19009565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea6b530-d41f-4b72-af93-e2cdb36addba", "name": "network-vif-plugged", "status": "completed", "tag": "fb676485-af3b-4d79-a796-74cac7d6e1ee"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:24.115942 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f8a32d8b-8603-4e8a-92e7-fd281aee0c28 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.185886 Jun 16 21:17:24.117472 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 363/679] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:23 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:24.121844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-8f967a00-a56e-4a12-ac7c-685715dc28c1 req-7b65618f-0c23-4a49-baa0-ce3c19009565 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:24.122120 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-8f967a00-a56e-4a12-ac7c-685715dc28c1 req-7b65618f-0c23-4a49-baa0-ce3c19009565 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:24.136234 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-8f967a00-a56e-4a12-ac7c-685715dc28c1 req-7b65618f-0c23-4a49-baa0-ce3c19009565 service nova] Creating event network-vif-plugged:fb676485-af3b-4d79-a796-74cac7d6e1ee for instance 5ea6b530-d41f-4b72-af93-e2cdb36addba on hv-cinder-81914 Jun 16 21:17:24.141394 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-8f967a00-a56e-4a12-ac7c-685715dc28c1 req-7b65618f-0c23-4a49-baa0-ce3c19009565 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034280 Jun 16 21:17:24.141980 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 317/680] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:17:24.368088 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9754099e-f643-466f-9e48-0a2bd1661e19 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:24.368776 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-9754099e-f643-466f-9e48-0a2bd1661e19 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:24.375409 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9754099e-f643-466f-9e48-0a2bd1661e19 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:24.375852 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9754099e-f643-466f-9e48-0a2bd1661e19 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:24.376653 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9754099e-f643-466f-9e48-0a2bd1661e19 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:24.377095 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9754099e-f643-466f-9e48-0a2bd1661e19 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:24.503413 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9754099e-f643-466f-9e48-0a2bd1661e19 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:24.510959 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9754099e-f643-466f-9e48-0a2bd1661e19 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 200 len: 1365 microversion: 2.1 time: 0.146976 Jun 16 21:17:24.511515 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 364/681] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:24 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:25.008376 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6c9b78e1-4b31-48ec-a543-188e666e55bc tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:25.009068 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6c9b78e1-4b31-48ec-a543-188e666e55bc tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:25.016302 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6c9b78e1-4b31-48ec-a543-188e666e55bc tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:25.016747 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6c9b78e1-4b31-48ec-a543-188e666e55bc tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:25.017500 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6c9b78e1-4b31-48ec-a543-188e666e55bc tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:25.017929 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6c9b78e1-4b31-48ec-a543-188e666e55bc tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:25.134729 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f2ccc6c3-6941-4454-8aeb-487e3bd6bd5f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:25.136280 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f2ccc6c3-6941-4454-8aeb-487e3bd6bd5f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:25.142802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f2ccc6c3-6941-4454-8aeb-487e3bd6bd5f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:25.143325 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f2ccc6c3-6941-4454-8aeb-487e3bd6bd5f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:25.144155 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f2ccc6c3-6941-4454-8aeb-487e3bd6bd5f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:25.144613 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f2ccc6c3-6941-4454-8aeb-487e3bd6bd5f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:25.150578 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6c9b78e1-4b31-48ec-a543-188e666e55bc tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:25.159622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6c9b78e1-4b31-48ec-a543-188e666e55bc tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.156066 Jun 16 21:17:25.160205 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 318/682] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:25 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:25.290346 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f2ccc6c3-6941-4454-8aeb-487e3bd6bd5f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:25.298702 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f2ccc6c3-6941-4454-8aeb-487e3bd6bd5f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.167813 Jun 16 21:17:25.299287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 365/683] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:25 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:25.527686 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6b4d68d1-c589-4cc4-a26c-e533fed1a184 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:25.528312 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6b4d68d1-c589-4cc4-a26c-e533fed1a184 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:25.534208 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6b4d68d1-c589-4cc4-a26c-e533fed1a184 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:25.534640 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6b4d68d1-c589-4cc4-a26c-e533fed1a184 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:25.535380 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6b4d68d1-c589-4cc4-a26c-e533fed1a184 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:25.535807 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6b4d68d1-c589-4cc4-a26c-e533fed1a184 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:25.664633 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6b4d68d1-c589-4cc4-a26c-e533fed1a184 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:25.671927 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6b4d68d1-c589-4cc4-a26c-e533fed1a184 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 200 len: 1365 microversion: 2.1 time: 0.148142 Jun 16 21:17:25.672517 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 319/684] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:25 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:26.175450 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-deebc5a1-2dde-497e-9a60-a33b5fac5ec5 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:26.176066 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-deebc5a1-2dde-497e-9a60-a33b5fac5ec5 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:26.182538 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-deebc5a1-2dde-497e-9a60-a33b5fac5ec5 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:26.183852 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-deebc5a1-2dde-497e-9a60-a33b5fac5ec5 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:26.184379 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-deebc5a1-2dde-497e-9a60-a33b5fac5ec5 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:26.184814 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-deebc5a1-2dde-497e-9a60-a33b5fac5ec5 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:26.231615 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:26.250353 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=6 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:26.316148 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b58bb5ce-f04e-493c-99d1-e63f4319899c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:26.316895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b58bb5ce-f04e-493c-99d1-e63f4319899c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:26.320091 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-deebc5a1-2dde-497e-9a60-a33b5fac5ec5 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:26.324141 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b58bb5ce-f04e-493c-99d1-e63f4319899c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:26.324898 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b58bb5ce-f04e-493c-99d1-e63f4319899c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:26.325718 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b58bb5ce-f04e-493c-99d1-e63f4319899c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:26.326222 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b58bb5ce-f04e-493c-99d1-e63f4319899c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:26.328557 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-deebc5a1-2dde-497e-9a60-a33b5fac5ec5 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.156894 Jun 16 21:17:26.329141 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 366/685] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:26 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:26.381797 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=6 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:26.471767 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b58bb5ce-f04e-493c-99d1-e63f4319899c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:26.479588 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b58bb5ce-f04e-493c-99d1-e63f4319899c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.167217 Jun 16 21:17:26.481262 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 320/686] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:26 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:26.688601 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0576b96f-58be-43bf-8ef2-b6f9d67dcf14 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:26.689207 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0576b96f-58be-43bf-8ef2-b6f9d67dcf14 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:26.695262 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0576b96f-58be-43bf-8ef2-b6f9d67dcf14 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:26.695704 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0576b96f-58be-43bf-8ef2-b6f9d67dcf14 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:26.696490 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0576b96f-58be-43bf-8ef2-b6f9d67dcf14 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:26.696919 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0576b96f-58be-43bf-8ef2-b6f9d67dcf14 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:26.827399 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0576b96f-58be-43bf-8ef2-b6f9d67dcf14 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:26.834724 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0576b96f-58be-43bf-8ef2-b6f9d67dcf14 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 200 len: 1365 microversion: 2.1 time: 0.149937 Jun 16 21:17:26.835282 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 367/687] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:26 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:27.345571 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0c66a83d-df67-4d5c-8be4-7a46e1b61365 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:27.346214 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0c66a83d-df67-4d5c-8be4-7a46e1b61365 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:27.352735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0c66a83d-df67-4d5c-8be4-7a46e1b61365 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:27.353180 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0c66a83d-df67-4d5c-8be4-7a46e1b61365 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:27.353942 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0c66a83d-df67-4d5c-8be4-7a46e1b61365 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:27.354380 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0c66a83d-df67-4d5c-8be4-7a46e1b61365 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:27.486267 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0c66a83d-df67-4d5c-8be4-7a46e1b61365 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:27.494159 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0c66a83d-df67-4d5c-8be4-7a46e1b61365 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.152476 Jun 16 21:17:27.494720 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 321/688] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:27 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:27.498416 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4e5be2c3-546d-4f78-979b-a004fe013a0f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:27.499057 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4e5be2c3-546d-4f78-979b-a004fe013a0f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:27.505218 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4e5be2c3-546d-4f78-979b-a004fe013a0f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:27.505654 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4e5be2c3-546d-4f78-979b-a004fe013a0f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:27.506415 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4e5be2c3-546d-4f78-979b-a004fe013a0f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:27.506844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4e5be2c3-546d-4f78-979b-a004fe013a0f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:27.655115 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4e5be2c3-546d-4f78-979b-a004fe013a0f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:27.662987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4e5be2c3-546d-4f78-979b-a004fe013a0f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.168894 Jun 16 21:17:27.663546 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 368/689] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:27 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:27.852589 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2ef2eaa5-5c72-47d2-a1ff-c15adafc4a26 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:27.853222 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2ef2eaa5-5c72-47d2-a1ff-c15adafc4a26 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:27.859910 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2ef2eaa5-5c72-47d2-a1ff-c15adafc4a26 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:27.860398 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2ef2eaa5-5c72-47d2-a1ff-c15adafc4a26 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:27.861152 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2ef2eaa5-5c72-47d2-a1ff-c15adafc4a26 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:27.861583 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2ef2eaa5-5c72-47d2-a1ff-c15adafc4a26 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:27.994337 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2ef2eaa5-5c72-47d2-a1ff-c15adafc4a26 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:28.001857 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2ef2eaa5-5c72-47d2-a1ff-c15adafc4a26 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 200 len: 1365 microversion: 2.1 time: 0.153070 Jun 16 21:17:28.002426 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 322/690] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:27 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:28.512307 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-6562d7a7-9cb1-4fcc-9353-b49a31ee289f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:28.512831 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-6562d7a7-9cb1-4fcc-9353-b49a31ee289f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:28.520271 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6562d7a7-9cb1-4fcc-9353-b49a31ee289f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:28.521084 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6562d7a7-9cb1-4fcc-9353-b49a31ee289f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:28.522034 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6562d7a7-9cb1-4fcc-9353-b49a31ee289f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:28.522511 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6562d7a7-9cb1-4fcc-9353-b49a31ee289f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:28.664860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6562d7a7-9cb1-4fcc-9353-b49a31ee289f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:28.672489 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-6562d7a7-9cb1-4fcc-9353-b49a31ee289f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.165238 Jun 16 21:17:28.673057 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 369/691] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:28 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:28.680720 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b29d70dc-937e-438c-b182-a2b957bba927 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:28.681336 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b29d70dc-937e-438c-b182-a2b957bba927 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:28.689557 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b29d70dc-937e-438c-b182-a2b957bba927 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:28.690244 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b29d70dc-937e-438c-b182-a2b957bba927 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:28.691048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b29d70dc-937e-438c-b182-a2b957bba927 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:28.691479 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b29d70dc-937e-438c-b182-a2b957bba927 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:28.834509 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b29d70dc-937e-438c-b182-a2b957bba927 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:28.842950 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b29d70dc-937e-438c-b182-a2b957bba927 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.166155 Jun 16 21:17:28.843503 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 323/692] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:28 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:29.018464 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-406e0bf5-0691-4501-9048-74301da27d05 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:29.019119 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-406e0bf5-0691-4501-9048-74301da27d05 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:29.025022 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-406e0bf5-0691-4501-9048-74301da27d05 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:29.025458 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-406e0bf5-0691-4501-9048-74301da27d05 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:29.026200 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-406e0bf5-0691-4501-9048-74301da27d05 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:29.027208 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-406e0bf5-0691-4501-9048-74301da27d05 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:29.153868 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-406e0bf5-0691-4501-9048-74301da27d05 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:29.161310 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-406e0bf5-0691-4501-9048-74301da27d05 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 200 len: 1555 microversion: 2.1 time: 0.146709 Jun 16 21:17:29.161876 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 370/693] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:29 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:29.177615 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-06ff2519-986a-44ac-8b1f-e7f4c1ccafea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:29.178112 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-06ff2519-986a-44ac-8b1f-e7f4c1ccafea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:29.184624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-06ff2519-986a-44ac-8b1f-e7f4c1ccafea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:29.185261 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-06ff2519-986a-44ac-8b1f-e7f4c1ccafea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:29.186030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-06ff2519-986a-44ac-8b1f-e7f4c1ccafea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:29.186465 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-06ff2519-986a-44ac-8b1f-e7f4c1ccafea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:29.269971 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-06ff2519-986a-44ac-8b1f-e7f4c1ccafea tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096144 Jun 16 21:17:29.270505 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 324/694] 10.222.0.43 () {58 vars in 1274 bytes} [Thu Jun 16 21:17:29 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:17:29.689933 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7d82de22-838d-4faa-bbc4-88fb7c258e7c tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:29.690576 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7d82de22-838d-4faa-bbc4-88fb7c258e7c tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:29.696974 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7d82de22-838d-4faa-bbc4-88fb7c258e7c tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:29.697420 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7d82de22-838d-4faa-bbc4-88fb7c258e7c tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:29.698177 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7d82de22-838d-4faa-bbc4-88fb7c258e7c tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:29.699442 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7d82de22-838d-4faa-bbc4-88fb7c258e7c tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:29.703477 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:29.842636 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7d82de22-838d-4faa-bbc4-88fb7c258e7c tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:29.850203 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7d82de22-838d-4faa-bbc4-88fb7c258e7c tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.164249 Jun 16 21:17:29.850775 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 371/695] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:29 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:29.861404 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-93efa5d5-5748-496b-94a8-69f8a4bb0be7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:29.862018 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-93efa5d5-5748-496b-94a8-69f8a4bb0be7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:29.868862 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-93efa5d5-5748-496b-94a8-69f8a4bb0be7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:29.869307 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-93efa5d5-5748-496b-94a8-69f8a4bb0be7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:29.870073 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-93efa5d5-5748-496b-94a8-69f8a4bb0be7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:29.871302 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-93efa5d5-5748-496b-94a8-69f8a4bb0be7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:30.359400 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-93efa5d5-5748-496b-94a8-69f8a4bb0be7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:30.367573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-93efa5d5-5748-496b-94a8-69f8a4bb0be7 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.510493 Jun 16 21:17:30.368144 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 325/696] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:29 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:30.524349 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5e172ac6-dd5c-4ca7-8d1d-950081530c26 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:30.524980 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5e172ac6-dd5c-4ca7-8d1d-950081530c26 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:30.534917 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5e172ac6-dd5c-4ca7-8d1d-950081530c26 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:30.535414 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5e172ac6-dd5c-4ca7-8d1d-950081530c26 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:30.540744 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-908680bb-648f-41c9-bf77-50769dfbdb12 req-075fa39a-b7f2-4bf7-945e-b91239d29b7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea6b530-d41f-4b72-af93-e2cdb36addba", "tag": "fb676485-af3b-4d79-a796-74cac7d6e1ee"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:30.544775 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5e172ac6-dd5c-4ca7-8d1d-950081530c26 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:30.545816 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5e172ac6-dd5c-4ca7-8d1d-950081530c26 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:30.549813 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-908680bb-648f-41c9-bf77-50769dfbdb12 req-075fa39a-b7f2-4bf7-945e-b91239d29b7e service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:30.551764 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-908680bb-648f-41c9-bf77-50769dfbdb12 req-075fa39a-b7f2-4bf7-945e-b91239d29b7e service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:30.565896 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-908680bb-648f-41c9-bf77-50769dfbdb12 req-075fa39a-b7f2-4bf7-945e-b91239d29b7e service nova] Creating event network-changed:fb676485-af3b-4d79-a796-74cac7d6e1ee for instance 5ea6b530-d41f-4b72-af93-e2cdb36addba on hv-cinder-81914 Jun 16 21:17:30.571036 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-908680bb-648f-41c9-bf77-50769dfbdb12 req-075fa39a-b7f2-4bf7-945e-b91239d29b7e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034066 Jun 16 21:17:30.571685 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 326/697] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:17:30.638304 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.objects.instance [None req-5e172ac6-dd5c-4ca7-8d1d-950081530c26 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lazy-loading 'services' on Instance uuid 499ae55d-60f9-480c-9ecd-794a1cee0da5 {{(pid=117737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:17:30.719268 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5e172ac6-dd5c-4ca7-8d1d-950081530c26 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "DELETE /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/os-volume_attachments/d2ac8076-d889-458b-b8c9-cc6c624e1fd5" status: 202 len: 0 microversion: 2.1 time: 0.199516 Jun 16 21:17:30.723817 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 372/698] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 16 21:17:30 2022] DELETE /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/os-volume_attachments/d2ac8076-d889-458b-b8c9-cc6c624e1fd5 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:17:30.867675 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-39a377bf-6fcc-45bd-a6a5-42ce9f17a3eb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:30.868459 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-39a377bf-6fcc-45bd-a6a5-42ce9f17a3eb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:30.871544 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:30.877089 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-39a377bf-6fcc-45bd-a6a5-42ce9f17a3eb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:30.877608 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-39a377bf-6fcc-45bd-a6a5-42ce9f17a3eb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:30.878450 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-39a377bf-6fcc-45bd-a6a5-42ce9f17a3eb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:30.878967 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-39a377bf-6fcc-45bd-a6a5-42ce9f17a3eb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:31.014697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-39a377bf-6fcc-45bd-a6a5-42ce9f17a3eb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:31.022208 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-39a377bf-6fcc-45bd-a6a5-42ce9f17a3eb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.158898 Jun 16 21:17:31.022776 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 327/699] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:30 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:31.390207 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f90acfb4-16ff-4c3e-a10c-2ce68bbc8abb tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:31.390919 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f90acfb4-16ff-4c3e-a10c-2ce68bbc8abb tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:31.397318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f90acfb4-16ff-4c3e-a10c-2ce68bbc8abb tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:31.398067 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f90acfb4-16ff-4c3e-a10c-2ce68bbc8abb tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:31.399042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f90acfb4-16ff-4c3e-a10c-2ce68bbc8abb tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:31.399703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f90acfb4-16ff-4c3e-a10c-2ce68bbc8abb tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:31.592318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f90acfb4-16ff-4c3e-a10c-2ce68bbc8abb tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:31.603390 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f90acfb4-16ff-4c3e-a10c-2ce68bbc8abb tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.221463 Jun 16 21:17:31.604278 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 373/700] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:31 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:32.039359 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8ea0e0de-eacc-4df7-8930-ba5448efc2ed tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:32.039976 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8ea0e0de-eacc-4df7-8930-ba5448efc2ed tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:32.047143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8ea0e0de-eacc-4df7-8930-ba5448efc2ed tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:32.047578 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8ea0e0de-eacc-4df7-8930-ba5448efc2ed tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:32.048442 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8ea0e0de-eacc-4df7-8930-ba5448efc2ed tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:32.048870 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8ea0e0de-eacc-4df7-8930-ba5448efc2ed tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:32.190360 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8ea0e0de-eacc-4df7-8930-ba5448efc2ed tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:32.199542 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8ea0e0de-eacc-4df7-8930-ba5448efc2ed tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.163405 Jun 16 21:17:32.200282 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 328/701] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:32 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:32.621805 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f18eff30-f58f-4e4c-b401-9bc61573855b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:32.623328 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f18eff30-f58f-4e4c-b401-9bc61573855b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:32.629807 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f18eff30-f58f-4e4c-b401-9bc61573855b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:32.630255 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f18eff30-f58f-4e4c-b401-9bc61573855b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:32.631012 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f18eff30-f58f-4e4c-b401-9bc61573855b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:32.631452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f18eff30-f58f-4e4c-b401-9bc61573855b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:32.783675 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f18eff30-f58f-4e4c-b401-9bc61573855b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:32.791862 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f18eff30-f58f-4e4c-b401-9bc61573855b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.173885 Jun 16 21:17:32.792470 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 374/702] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:32 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:32.922563 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-35c2d3c0-fda8-4a53-be96-d6234cdf5e74 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:32.928575 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-35c2d3c0-fda8-4a53-be96-d6234cdf5e74 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:32.929023 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-35c2d3c0-fda8-4a53-be96-d6234cdf5e74 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:32.989630 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-35c2d3c0-fda8-4a53-be96-d6234cdf5e74 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Going to try to stop instance {{(pid=117738) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 21:17:33.032115 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-35c2d3c0-fda8-4a53-be96-d6234cdf5e74 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "POST /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/action" status: 202 len: 0 microversion: 2.1 time: 0.114531 Jun 16 21:17:33.032748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 329/703] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 16 21:17:32 2022] POST /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:17:33.040843 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-2a051476-3991-4ddd-a027-4e9db802e3d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:33.041465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-2a051476-3991-4ddd-a027-4e9db802e3d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:33.048580 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2a051476-3991-4ddd-a027-4e9db802e3d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:33.049040 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2a051476-3991-4ddd-a027-4e9db802e3d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:33.049883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2a051476-3991-4ddd-a027-4e9db802e3d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:33.050415 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2a051476-3991-4ddd-a027-4e9db802e3d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:33.184110 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2a051476-3991-4ddd-a027-4e9db802e3d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:33.192882 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-2a051476-3991-4ddd-a027-4e9db802e3d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1677 microversion: 2.1 time: 0.155877 Jun 16 21:17:33.193448 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 375/704] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:33 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:33.217484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-54fc88d3-302b-4332-ba24-a3552fbe8f4d tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:33.218170 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-54fc88d3-302b-4332-ba24-a3552fbe8f4d tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:33.224596 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-54fc88d3-302b-4332-ba24-a3552fbe8f4d tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:33.225046 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-54fc88d3-302b-4332-ba24-a3552fbe8f4d tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:33.225843 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-54fc88d3-302b-4332-ba24-a3552fbe8f4d tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:33.226276 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-54fc88d3-302b-4332-ba24-a3552fbe8f4d tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:33.358804 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-54fc88d3-302b-4332-ba24-a3552fbe8f4d tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:33.361128 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:33.368874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-54fc88d3-302b-4332-ba24-a3552fbe8f4d tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.156103 Jun 16 21:17:33.369641 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 330/705] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:33 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:33.808876 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a8305e99-d927-4a4c-b6b7-bbec8e68d6c2 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:33.809479 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a8305e99-d927-4a4c-b6b7-bbec8e68d6c2 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:33.816559 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a8305e99-d927-4a4c-b6b7-bbec8e68d6c2 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:33.816998 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a8305e99-d927-4a4c-b6b7-bbec8e68d6c2 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:33.817750 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a8305e99-d927-4a4c-b6b7-bbec8e68d6c2 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:33.818175 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a8305e99-d927-4a4c-b6b7-bbec8e68d6c2 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:33.973791 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a8305e99-d927-4a4c-b6b7-bbec8e68d6c2 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:33.981685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a8305e99-d927-4a4c-b6b7-bbec8e68d6c2 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.176589 Jun 16 21:17:33.982895 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 376/706] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:33 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:34.210954 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2fc69002-6dff-4e89-89a1-9fcc049b47a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:34.211488 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2fc69002-6dff-4e89-89a1-9fcc049b47a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:34.221629 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2fc69002-6dff-4e89-89a1-9fcc049b47a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:34.222258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2fc69002-6dff-4e89-89a1-9fcc049b47a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:34.222839 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2fc69002-6dff-4e89-89a1-9fcc049b47a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:34.223274 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2fc69002-6dff-4e89-89a1-9fcc049b47a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:34.357601 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2fc69002-6dff-4e89-89a1-9fcc049b47a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:34.365863 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2fc69002-6dff-4e89-89a1-9fcc049b47a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1677 microversion: 2.1 time: 0.159007 Jun 16 21:17:34.366422 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 331/707] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:34 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:34.385798 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c9947d32-8213-4aba-abc2-c84e168e049b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:34.386412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c9947d32-8213-4aba-abc2-c84e168e049b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:34.392532 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c9947d32-8213-4aba-abc2-c84e168e049b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:34.392977 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c9947d32-8213-4aba-abc2-c84e168e049b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:34.393735 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c9947d32-8213-4aba-abc2-c84e168e049b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:34.394168 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c9947d32-8213-4aba-abc2-c84e168e049b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:34.524363 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c9947d32-8213-4aba-abc2-c84e168e049b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:34.532528 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c9947d32-8213-4aba-abc2-c84e168e049b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.150474 Jun 16 21:17:34.533089 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 377/708] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:34 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:34.999984 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b505cfc9-b33d-42be-b7a9-fb9b77f5bb34 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:35.000628 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b505cfc9-b33d-42be-b7a9-fb9b77f5bb34 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:35.006642 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b505cfc9-b33d-42be-b7a9-fb9b77f5bb34 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:35.007093 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b505cfc9-b33d-42be-b7a9-fb9b77f5bb34 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:35.007852 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b505cfc9-b33d-42be-b7a9-fb9b77f5bb34 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:35.008312 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b505cfc9-b33d-42be-b7a9-fb9b77f5bb34 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:35.164425 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b505cfc9-b33d-42be-b7a9-fb9b77f5bb34 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:35.174441 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b505cfc9-b33d-42be-b7a9-fb9b77f5bb34 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.178855 Jun 16 21:17:35.175020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 332/709] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:34 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:35.383987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-13dfec3a-dc18-4015-b60c-2f1d5ce46cc5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:35.384681 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-13dfec3a-dc18-4015-b60c-2f1d5ce46cc5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:35.391059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-13dfec3a-dc18-4015-b60c-2f1d5ce46cc5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:35.391495 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-13dfec3a-dc18-4015-b60c-2f1d5ce46cc5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:35.392281 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-13dfec3a-dc18-4015-b60c-2f1d5ce46cc5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:35.392706 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-13dfec3a-dc18-4015-b60c-2f1d5ce46cc5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:35.525877 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-13dfec3a-dc18-4015-b60c-2f1d5ce46cc5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:35.534148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-13dfec3a-dc18-4015-b60c-2f1d5ce46cc5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1677 microversion: 2.1 time: 0.153960 Jun 16 21:17:35.534720 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 378/710] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:35 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:35.550919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c214e5a1-1578-4b5e-adea-ee7538bd48ac tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:35.551527 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c214e5a1-1578-4b5e-adea-ee7538bd48ac tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:35.558019 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c214e5a1-1578-4b5e-adea-ee7538bd48ac tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:35.558462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c214e5a1-1578-4b5e-adea-ee7538bd48ac tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:35.559218 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c214e5a1-1578-4b5e-adea-ee7538bd48ac tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:35.559645 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c214e5a1-1578-4b5e-adea-ee7538bd48ac tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:35.690366 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c214e5a1-1578-4b5e-adea-ee7538bd48ac tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:35.697731 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c214e5a1-1578-4b5e-adea-ee7538bd48ac tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.150638 Jun 16 21:17:35.698277 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 333/711] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:35 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:36.191851 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-12b82b70-2085-42d3-8d05-827180010f55 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:36.192489 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-12b82b70-2085-42d3-8d05-827180010f55 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:36.194473 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:36.199673 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-12b82b70-2085-42d3-8d05-827180010f55 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:36.200109 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-12b82b70-2085-42d3-8d05-827180010f55 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:36.200879 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-12b82b70-2085-42d3-8d05-827180010f55 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:36.201301 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-12b82b70-2085-42d3-8d05-827180010f55 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:36.349931 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-12b82b70-2085-42d3-8d05-827180010f55 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:36.357885 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-12b82b70-2085-42d3-8d05-827180010f55 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.169862 Jun 16 21:17:36.358446 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 379/712] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:36 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:36.551829 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-85cfbdd5-6531-4d97-85c1-3173320df27e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:36.552469 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-85cfbdd5-6531-4d97-85c1-3173320df27e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:36.558473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-85cfbdd5-6531-4d97-85c1-3173320df27e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:36.558915 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-85cfbdd5-6531-4d97-85c1-3173320df27e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:36.559670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-85cfbdd5-6531-4d97-85c1-3173320df27e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:36.560098 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-85cfbdd5-6531-4d97-85c1-3173320df27e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:36.715189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a39bd647-b26e-4a5a-b16b-9660227ae209 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:36.715723 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a39bd647-b26e-4a5a-b16b-9660227ae209 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:36.722680 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a39bd647-b26e-4a5a-b16b-9660227ae209 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:36.723129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a39bd647-b26e-4a5a-b16b-9660227ae209 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:36.723901 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a39bd647-b26e-4a5a-b16b-9660227ae209 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:36.724360 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a39bd647-b26e-4a5a-b16b-9660227ae209 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:36.808058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-85cfbdd5-6531-4d97-85c1-3173320df27e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:36.819549 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-85cfbdd5-6531-4d97-85c1-3173320df27e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1677 microversion: 2.1 time: 0.272293 Jun 16 21:17:36.820403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 334/713] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:36 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1677 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:36.882754 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a39bd647-b26e-4a5a-b16b-9660227ae209 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:36.890196 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a39bd647-b26e-4a5a-b16b-9660227ae209 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.178895 Jun 16 21:17:36.891585 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 380/714] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:36 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:37.376316 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-39091ad7-7e8d-467b-a964-f0a072d839fa tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:37.376929 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-39091ad7-7e8d-467b-a964-f0a072d839fa tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:37.382909 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-39091ad7-7e8d-467b-a964-f0a072d839fa tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:37.383352 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-39091ad7-7e8d-467b-a964-f0a072d839fa tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:37.384120 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-39091ad7-7e8d-467b-a964-f0a072d839fa tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:37.384592 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-39091ad7-7e8d-467b-a964-f0a072d839fa tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:37.529644 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-39091ad7-7e8d-467b-a964-f0a072d839fa tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:37.537994 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-39091ad7-7e8d-467b-a964-f0a072d839fa tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.166147 Jun 16 21:17:37.538577 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 335/715] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:37 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:37.836896 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-6116ffb5-41b1-4fe4-b720-3eea58f2bbde tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:37.837611 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-6116ffb5-41b1-4fe4-b720-3eea58f2bbde tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:37.844909 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6116ffb5-41b1-4fe4-b720-3eea58f2bbde tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:37.845472 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6116ffb5-41b1-4fe4-b720-3eea58f2bbde tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:37.846350 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6116ffb5-41b1-4fe4-b720-3eea58f2bbde tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:37.847029 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6116ffb5-41b1-4fe4-b720-3eea58f2bbde tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:37.908773 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c06ac274-5ee7-4530-a9fd-a1cbb95dfebd tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:37.909389 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c06ac274-5ee7-4530-a9fd-a1cbb95dfebd tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:37.916460 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c06ac274-5ee7-4530-a9fd-a1cbb95dfebd tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:37.916908 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c06ac274-5ee7-4530-a9fd-a1cbb95dfebd tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:37.917704 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c06ac274-5ee7-4530-a9fd-a1cbb95dfebd tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:37.918139 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c06ac274-5ee7-4530-a9fd-a1cbb95dfebd tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:37.991027 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6116ffb5-41b1-4fe4-b720-3eea58f2bbde tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:37.998912 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-6116ffb5-41b1-4fe4-b720-3eea58f2bbde tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1677 microversion: 2.1 time: 0.165849 Jun 16 21:17:38.000097 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 381/716] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:37 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:38.064932 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c06ac274-5ee7-4530-a9fd-a1cbb95dfebd tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:38.072386 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c06ac274-5ee7-4530-a9fd-a1cbb95dfebd tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.168427 Jun 16 21:17:38.072970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 336/717] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:37 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:38.555487 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-fed7e8ee-56bb-42aa-af94-e1c9a21b6835 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:38.556099 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-fed7e8ee-56bb-42aa-af94-e1c9a21b6835 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:38.563577 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fed7e8ee-56bb-42aa-af94-e1c9a21b6835 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:38.564097 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fed7e8ee-56bb-42aa-af94-e1c9a21b6835 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:38.564924 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fed7e8ee-56bb-42aa-af94-e1c9a21b6835 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:38.565518 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fed7e8ee-56bb-42aa-af94-e1c9a21b6835 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:38.574405 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b9896d6c-6504-4841-a0ba-4b262b0e53bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:38.575143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b9896d6c-6504-4841-a0ba-4b262b0e53bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:38.582280 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b9896d6c-6504-4841-a0ba-4b262b0e53bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:38.582930 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b9896d6c-6504-4841-a0ba-4b262b0e53bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:38.583790 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b9896d6c-6504-4841-a0ba-4b262b0e53bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:38.584352 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b9896d6c-6504-4841-a0ba-4b262b0e53bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:38.617721 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b9896d6c-6504-4841-a0ba-4b262b0e53bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-volume_attachments/ed9a9fdf-96c4-4bd0-8e16-817d190ed4b5" status: 200 len: 194 microversion: 2.20 time: 0.047962 Jun 16 21:17:38.618326 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 337/718] 10.222.0.43 () {60 vars in 1453 bytes} [Thu Jun 16 21:17:38 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-volume_attachments/ed9a9fdf-96c4-4bd0-8e16-817d190ed4b5 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 21:17:38.683495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b8e2e816-b5e2-495d-81ab-0710c30b5c74 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:38.683992 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b8e2e816-b5e2-495d-81ab-0710c30b5c74 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:38.691121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b8e2e816-b5e2-495d-81ab-0710c30b5c74 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:38.691559 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b8e2e816-b5e2-495d-81ab-0710c30b5c74 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:38.692383 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b8e2e816-b5e2-495d-81ab-0710c30b5c74 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:38.692814 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b8e2e816-b5e2-495d-81ab-0710c30b5c74 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:38.721666 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-fed7e8ee-56bb-42aa-af94-e1c9a21b6835 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:38.730124 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-fed7e8ee-56bb-42aa-af94-e1c9a21b6835 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.178463 Jun 16 21:17:38.730771 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 382/719] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:38 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:38.776290 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.objects.instance [None req-b8e2e816-b5e2-495d-81ab-0710c30b5c74 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lazy-loading 'services' on Instance uuid 2281b8c3-ec1f-478b-bd50-128d5cf67a04 {{(pid=117738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:17:38.853403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b8e2e816-b5e2-495d-81ab-0710c30b5c74 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-volume_attachments/ed9a9fdf-96c4-4bd0-8e16-817d190ed4b5" status: 202 len: 0 microversion: 2.20 time: 0.173665 Jun 16 21:17:38.853971 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 338/720] 10.222.0.43 () {60 vars in 1456 bytes} [Thu Jun 16 21:17:38 2022] DELETE /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-volume_attachments/ed9a9fdf-96c4-4bd0-8e16-817d190ed4b5 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 21:17:38.862812 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4a67342e-db75-4975-9a32-fc1e82ac1c0b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:38.863793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4a67342e-db75-4975-9a32-fc1e82ac1c0b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:38.870282 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4a67342e-db75-4975-9a32-fc1e82ac1c0b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:38.870729 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4a67342e-db75-4975-9a32-fc1e82ac1c0b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:38.871497 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4a67342e-db75-4975-9a32-fc1e82ac1c0b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:38.871958 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4a67342e-db75-4975-9a32-fc1e82ac1c0b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:38.903259 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4a67342e-db75-4975-9a32-fc1e82ac1c0b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044833 Jun 16 21:17:38.903815 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 383/721] 10.222.0.43 () {60 vars in 1342 bytes} [Thu Jun 16 21:17:38 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:17:39.017609 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d9c09b35-5b80-44b2-9960-0f9e45cb8bf6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:39.018304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d9c09b35-5b80-44b2-9960-0f9e45cb8bf6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:39.024795 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9c09b35-5b80-44b2-9960-0f9e45cb8bf6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:39.025250 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9c09b35-5b80-44b2-9960-0f9e45cb8bf6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:39.026050 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9c09b35-5b80-44b2-9960-0f9e45cb8bf6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:39.026520 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9c09b35-5b80-44b2-9960-0f9e45cb8bf6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:39.089620 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e970d621-3c1c-4745-a936-b4d943712ca8 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:39.090142 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e970d621-3c1c-4745-a936-b4d943712ca8 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:39.096961 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e970d621-3c1c-4745-a936-b4d943712ca8 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:39.097400 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e970d621-3c1c-4745-a936-b4d943712ca8 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:39.098153 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e970d621-3c1c-4745-a936-b4d943712ca8 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:39.098579 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e970d621-3c1c-4745-a936-b4d943712ca8 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:39.160724 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d9c09b35-5b80-44b2-9960-0f9e45cb8bf6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:39.168098 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d9c09b35-5b80-44b2-9960-0f9e45cb8bf6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1677 microversion: 2.1 time: 0.155622 Jun 16 21:17:39.168689 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 339/722] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:39 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:39.233033 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e970d621-3c1c-4745-a936-b4d943712ca8 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:39.241521 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e970d621-3c1c-4745-a936-b4d943712ca8 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.155951 Jun 16 21:17:39.242083 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 384/723] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:39 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:39.747151 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a6b892e2-b722-47ad-b8a6-83e09fca9767 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:39.747762 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a6b892e2-b722-47ad-b8a6-83e09fca9767 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:39.753780 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a6b892e2-b722-47ad-b8a6-83e09fca9767 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:39.754225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a6b892e2-b722-47ad-b8a6-83e09fca9767 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:39.755005 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a6b892e2-b722-47ad-b8a6-83e09fca9767 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:39.755456 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a6b892e2-b722-47ad-b8a6-83e09fca9767 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:39.897070 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a6b892e2-b722-47ad-b8a6-83e09fca9767 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:39.904958 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a6b892e2-b722-47ad-b8a6-83e09fca9767 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.161629 Jun 16 21:17:39.905598 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 340/724] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:39 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:39.916412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7b8b70b4-532d-4297-bbe5-4208e86f84b3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:39.917356 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7b8b70b4-532d-4297-bbe5-4208e86f84b3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:39.923851 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7b8b70b4-532d-4297-bbe5-4208e86f84b3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:39.924334 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7b8b70b4-532d-4297-bbe5-4208e86f84b3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:39.925098 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7b8b70b4-532d-4297-bbe5-4208e86f84b3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:39.925562 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7b8b70b4-532d-4297-bbe5-4208e86f84b3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:39.955335 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7b8b70b4-532d-4297-bbe5-4208e86f84b3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042866 Jun 16 21:17:39.955887 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 385/725] 10.222.0.43 () {60 vars in 1342 bytes} [Thu Jun 16 21:17:39 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:17:40.185724 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7fc3d321-c279-4f56-9035-f34de35f2b14 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:40.186307 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7fc3d321-c279-4f56-9035-f34de35f2b14 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:40.193275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7fc3d321-c279-4f56-9035-f34de35f2b14 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:40.194571 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7fc3d321-c279-4f56-9035-f34de35f2b14 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:40.194571 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7fc3d321-c279-4f56-9035-f34de35f2b14 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:40.194571 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7fc3d321-c279-4f56-9035-f34de35f2b14 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:40.259821 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7e3429d0-f000-4447-9cdc-ed3243089a98 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:40.260464 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7e3429d0-f000-4447-9cdc-ed3243089a98 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:40.267152 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7e3429d0-f000-4447-9cdc-ed3243089a98 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:40.267602 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7e3429d0-f000-4447-9cdc-ed3243089a98 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:40.268400 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7e3429d0-f000-4447-9cdc-ed3243089a98 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:40.268835 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7e3429d0-f000-4447-9cdc-ed3243089a98 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:40.330931 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-7fc3d321-c279-4f56-9035-f34de35f2b14 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:40.338493 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7fc3d321-c279-4f56-9035-f34de35f2b14 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1677 microversion: 2.1 time: 0.156714 Jun 16 21:17:40.339053 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 341/726] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:40 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:40.399713 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7e3429d0-f000-4447-9cdc-ed3243089a98 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:40.407895 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7e3429d0-f000-4447-9cdc-ed3243089a98 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.152977 Jun 16 21:17:40.408494 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 386/727] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:40 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:40.922686 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a1e82e64-cf66-4525-99fc-e35d746e049d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:40.923315 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a1e82e64-cf66-4525-99fc-e35d746e049d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:40.929314 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a1e82e64-cf66-4525-99fc-e35d746e049d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:40.929750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a1e82e64-cf66-4525-99fc-e35d746e049d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:40.930493 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a1e82e64-cf66-4525-99fc-e35d746e049d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:40.930918 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a1e82e64-cf66-4525-99fc-e35d746e049d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:40.966937 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a731c566-e94f-4a8a-821f-f8ed7d55a2c2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:40.967844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a731c566-e94f-4a8a-821f-f8ed7d55a2c2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:40.974662 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a731c566-e94f-4a8a-821f-f8ed7d55a2c2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:40.975100 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a731c566-e94f-4a8a-821f-f8ed7d55a2c2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:40.975862 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a731c566-e94f-4a8a-821f-f8ed7d55a2c2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:40.976308 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a731c566-e94f-4a8a-821f-f8ed7d55a2c2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:40.979942 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:41.006738 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a731c566-e94f-4a8a-821f-f8ed7d55a2c2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043573 Jun 16 21:17:41.007315 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 387/728] 10.222.0.43 () {60 vars in 1342 bytes} [Thu Jun 16 21:17:40 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 21:17:41.074582 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a1e82e64-cf66-4525-99fc-e35d746e049d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:41.082587 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a1e82e64-cf66-4525-99fc-e35d746e049d tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.163736 Jun 16 21:17:41.083079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 342/729] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:40 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:41.356419 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-17b3f453-c7c7-4fc5-a970-92ebd270dc23 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:41.356964 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-17b3f453-c7c7-4fc5-a970-92ebd270dc23 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:41.363547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-17b3f453-c7c7-4fc5-a970-92ebd270dc23 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:41.363986 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-17b3f453-c7c7-4fc5-a970-92ebd270dc23 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:41.364773 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-17b3f453-c7c7-4fc5-a970-92ebd270dc23 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:41.365203 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-17b3f453-c7c7-4fc5-a970-92ebd270dc23 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:41.425497 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4f71db51-bceb-4b20-90d3-004fbe0ce36f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:41.426218 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4f71db51-bceb-4b20-90d3-004fbe0ce36f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:41.432921 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4f71db51-bceb-4b20-90d3-004fbe0ce36f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:41.433442 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4f71db51-bceb-4b20-90d3-004fbe0ce36f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:41.434298 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4f71db51-bceb-4b20-90d3-004fbe0ce36f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:41.434804 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4f71db51-bceb-4b20-90d3-004fbe0ce36f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:41.496433 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-17b3f453-c7c7-4fc5-a970-92ebd270dc23 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:41.503897 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-17b3f453-c7c7-4fc5-a970-92ebd270dc23 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1677 microversion: 2.1 time: 0.151392 Jun 16 21:17:41.504506 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 388/730] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:41 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:41.571496 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4f71db51-bceb-4b20-90d3-004fbe0ce36f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:41.580063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4f71db51-bceb-4b20-90d3-004fbe0ce36f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.158777 Jun 16 21:17:41.580353 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 343/731] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:41 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:42.018623 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-339e84cd-1df6-4ded-8eb8-b6b7be59a3f8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:42.019462 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-339e84cd-1df6-4ded-8eb8-b6b7be59a3f8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:42.025902 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-339e84cd-1df6-4ded-8eb8-b6b7be59a3f8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:42.026348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-339e84cd-1df6-4ded-8eb8-b6b7be59a3f8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:42.027116 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-339e84cd-1df6-4ded-8eb8-b6b7be59a3f8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:42.027543 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-339e84cd-1df6-4ded-8eb8-b6b7be59a3f8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:42.056012 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-339e84cd-1df6-4ded-8eb8-b6b7be59a3f8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041685 Jun 16 21:17:42.056588 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 389/732] 10.222.0.43 () {60 vars in 1342 bytes} [Thu Jun 16 21:17:42 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:17:42.098761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9019bbc7-ce32-4357-a3ef-401bec86c26b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:42.099361 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-9019bbc7-ce32-4357-a3ef-401bec86c26b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:42.105369 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9019bbc7-ce32-4357-a3ef-401bec86c26b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:42.105806 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9019bbc7-ce32-4357-a3ef-401bec86c26b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:42.106552 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9019bbc7-ce32-4357-a3ef-401bec86c26b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:42.106978 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9019bbc7-ce32-4357-a3ef-401bec86c26b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:42.251239 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9019bbc7-ce32-4357-a3ef-401bec86c26b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:42.259276 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-9019bbc7-ce32-4357-a3ef-401bec86c26b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.164361 Jun 16 21:17:42.259837 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 344/733] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:42 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:42.521578 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8bd96a82-c67d-499e-b9e6-ed89842e77e3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:42.522192 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8bd96a82-c67d-499e-b9e6-ed89842e77e3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:42.528129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8bd96a82-c67d-499e-b9e6-ed89842e77e3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:42.528729 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8bd96a82-c67d-499e-b9e6-ed89842e77e3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:42.529488 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8bd96a82-c67d-499e-b9e6-ed89842e77e3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:42.529915 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8bd96a82-c67d-499e-b9e6-ed89842e77e3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:42.601138 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-21ab622f-1c5f-490e-a4d6-df8fd188a5eb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:42.602523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-21ab622f-1c5f-490e-a4d6-df8fd188a5eb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:42.610271 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-21ab622f-1c5f-490e-a4d6-df8fd188a5eb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:42.611134 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-21ab622f-1c5f-490e-a4d6-df8fd188a5eb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:42.612009 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-21ab622f-1c5f-490e-a4d6-df8fd188a5eb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:42.612384 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-21ab622f-1c5f-490e-a4d6-df8fd188a5eb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:42.751685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8bd96a82-c67d-499e-b9e6-ed89842e77e3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:42.760622 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8bd96a82-c67d-499e-b9e6-ed89842e77e3 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1677 microversion: 2.1 time: 0.242790 Jun 16 21:17:42.763648 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 390/734] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:42 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1677 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:42.784491 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-21ab622f-1c5f-490e-a4d6-df8fd188a5eb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:42.794532 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-21ab622f-1c5f-490e-a4d6-df8fd188a5eb tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.202574 Jun 16 21:17:42.795803 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 345/735] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:42 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:43.067933 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ab57f1d5-f585-4c91-b0b0-c86b065499f5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:43.068997 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ab57f1d5-f585-4c91-b0b0-c86b065499f5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:43.075530 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ab57f1d5-f585-4c91-b0b0-c86b065499f5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:43.076047 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ab57f1d5-f585-4c91-b0b0-c86b065499f5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:43.076915 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ab57f1d5-f585-4c91-b0b0-c86b065499f5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:43.077438 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ab57f1d5-f585-4c91-b0b0-c86b065499f5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:43.107477 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ab57f1d5-f585-4c91-b0b0-c86b065499f5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043464 Jun 16 21:17:43.108046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 391/736] 10.222.0.43 () {60 vars in 1342 bytes} [Thu Jun 16 21:17:43 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:43.165715 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a2e2eed7-1b3f-4269-9d07-d9d29625ba26 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:43.166212 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a2e2eed7-1b3f-4269-9d07-d9d29625ba26 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:43.172307 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a2e2eed7-1b3f-4269-9d07-d9d29625ba26 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:43.172766 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a2e2eed7-1b3f-4269-9d07-d9d29625ba26 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:43.173521 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a2e2eed7-1b3f-4269-9d07-d9d29625ba26 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:43.173955 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a2e2eed7-1b3f-4269-9d07-d9d29625ba26 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:43.198077 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a2e2eed7-1b3f-4269-9d07-d9d29625ba26 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Going to try to terminate instance {{(pid=117738) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:17:43.200835 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:43.279663 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a2e2eed7-1b3f-4269-9d07-d9d29625ba26 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 204 len: 0 microversion: 2.20 time: 0.117423 Jun 16 21:17:43.279906 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-09563648-b1f5-4946-a6b5-7907cc6bf570 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:43.280249 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 346/737] 10.222.0.43 () {60 vars in 1279 bytes} [Thu Jun 16 21:17:43 2022] DELETE /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 21:17:43.280354 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-09563648-b1f5-4946-a6b5-7907cc6bf570 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:43.288274 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-09563648-b1f5-4946-a6b5-7907cc6bf570 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:43.288722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-09563648-b1f5-4946-a6b5-7907cc6bf570 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:43.289486 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-09563648-b1f5-4946-a6b5-7907cc6bf570 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:43.289913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-09563648-b1f5-4946-a6b5-7907cc6bf570 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:43.292758 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2e24da81-7706-41a7-bce5-02daa4407ce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:43.293501 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2e24da81-7706-41a7-bce5-02daa4407ce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:43.300741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e24da81-7706-41a7-bce5-02daa4407ce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:43.301349 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e24da81-7706-41a7-bce5-02daa4407ce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:43.302136 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e24da81-7706-41a7-bce5-02daa4407ce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:43.302751 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e24da81-7706-41a7-bce5-02daa4407ce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:43.438711 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2e24da81-7706-41a7-bce5-02daa4407ce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:43.439982 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-09563648-b1f5-4946-a6b5-7907cc6bf570 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:43.446615 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2e24da81-7706-41a7-bce5-02daa4407ce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:43.447927 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-09563648-b1f5-4946-a6b5-7907cc6bf570 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.172609 Jun 16 21:17:43.448083 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2e24da81-7706-41a7-bce5-02daa4407ce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:43.448774 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 392/738] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:43 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:43.449325 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2e24da81-7706-41a7-bce5-02daa4407ce0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.164111 Jun 16 21:17:43.449866 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 347/739] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:17:43 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:17:43.778893 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ef7401fc-f290-4f65-a154-0598fda3dade tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:43.779505 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ef7401fc-f290-4f65-a154-0598fda3dade tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:43.786658 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ef7401fc-f290-4f65-a154-0598fda3dade tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:43.787105 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ef7401fc-f290-4f65-a154-0598fda3dade tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:43.787865 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ef7401fc-f290-4f65-a154-0598fda3dade tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:43.788327 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ef7401fc-f290-4f65-a154-0598fda3dade tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:43.812316 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a502c7ed-4abf-4eca-b98e-4206522f41d3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:43.813060 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a502c7ed-4abf-4eca-b98e-4206522f41d3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:43.819474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a502c7ed-4abf-4eca-b98e-4206522f41d3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:43.820089 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a502c7ed-4abf-4eca-b98e-4206522f41d3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:43.820921 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a502c7ed-4abf-4eca-b98e-4206522f41d3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:43.821356 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a502c7ed-4abf-4eca-b98e-4206522f41d3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:43.931025 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-ef7401fc-f290-4f65-a154-0598fda3dade tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:43.940913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ef7401fc-f290-4f65-a154-0598fda3dade tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1677 microversion: 2.1 time: 0.166031 Jun 16 21:17:43.941680 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 393/740] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:43 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:43.963415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a502c7ed-4abf-4eca-b98e-4206522f41d3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:43.971369 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a502c7ed-4abf-4eca-b98e-4206522f41d3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.162905 Jun 16 21:17:43.971921 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 348/741] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:43 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:44.464574 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a0608a88-fd10-4294-a5b2-43b86f67f98b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:44.465162 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a0608a88-fd10-4294-a5b2-43b86f67f98b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:44.466924 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b4004649-9e4e-4a0b-961f-cd14e326e58b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:44.467535 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b4004649-9e4e-4a0b-961f-cd14e326e58b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:44.471690 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a0608a88-fd10-4294-a5b2-43b86f67f98b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:44.472123 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a0608a88-fd10-4294-a5b2-43b86f67f98b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:44.472901 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a0608a88-fd10-4294-a5b2-43b86f67f98b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:44.473329 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a0608a88-fd10-4294-a5b2-43b86f67f98b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:44.473629 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b4004649-9e4e-4a0b-961f-cd14e326e58b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:44.474082 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b4004649-9e4e-4a0b-961f-cd14e326e58b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:44.474843 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b4004649-9e4e-4a0b-961f-cd14e326e58b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:44.475276 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b4004649-9e4e-4a0b-961f-cd14e326e58b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:44.617817 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b4004649-9e4e-4a0b-961f-cd14e326e58b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:44.621375 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a0608a88-fd10-4294-a5b2-43b86f67f98b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:44.627313 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b4004649-9e4e-4a0b-961f-cd14e326e58b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:44.628826 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b4004649-9e4e-4a0b-961f-cd14e326e58b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:44.629983 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b4004649-9e4e-4a0b-961f-cd14e326e58b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.166908 Jun 16 21:17:44.630177 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a0608a88-fd10-4294-a5b2-43b86f67f98b tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.169543 Jun 16 21:17:44.630531 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 349/742] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:17:44 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:17:44.630749 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 394/743] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:44 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:44.957946 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-34c465e3-6aa2-41a7-ba7b-12706110d477 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:44.958589 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-34c465e3-6aa2-41a7-ba7b-12706110d477 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:44.965057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-34c465e3-6aa2-41a7-ba7b-12706110d477 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:44.965500 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-34c465e3-6aa2-41a7-ba7b-12706110d477 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:44.966256 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-34c465e3-6aa2-41a7-ba7b-12706110d477 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:44.966688 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-34c465e3-6aa2-41a7-ba7b-12706110d477 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:44.988754 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-fca5ab9b-7f11-4307-99c1-72c6d019db79 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:44.989362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-fca5ab9b-7f11-4307-99c1-72c6d019db79 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:44.995486 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fca5ab9b-7f11-4307-99c1-72c6d019db79 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:44.995926 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fca5ab9b-7f11-4307-99c1-72c6d019db79 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:44.996715 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fca5ab9b-7f11-4307-99c1-72c6d019db79 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:44.997146 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fca5ab9b-7f11-4307-99c1-72c6d019db79 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:45.095548 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-34c465e3-6aa2-41a7-ba7b-12706110d477 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:45.103010 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-34c465e3-6aa2-41a7-ba7b-12706110d477 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1677 microversion: 2.1 time: 0.148886 Jun 16 21:17:45.103572 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 350/744] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:44 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:45.133734 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-fca5ab9b-7f11-4307-99c1-72c6d019db79 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:45.142071 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-fca5ab9b-7f11-4307-99c1-72c6d019db79 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.157921 Jun 16 21:17:45.142574 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 395/745] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:44 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:45.646738 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-dc484461-51e6-44a4-8335-4aa84f4565b6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:45.647458 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-dc484461-51e6-44a4-8335-4aa84f4565b6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:45.647586 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-53a46fd1-0c0a-43f0-9732-e7da0f7c80d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:45.648062 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-53a46fd1-0c0a-43f0-9732-e7da0f7c80d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:45.653737 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-dc484461-51e6-44a4-8335-4aa84f4565b6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:45.654183 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-dc484461-51e6-44a4-8335-4aa84f4565b6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:45.654311 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-53a46fd1-0c0a-43f0-9732-e7da0f7c80d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:45.654750 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-53a46fd1-0c0a-43f0-9732-e7da0f7c80d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:45.654971 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-dc484461-51e6-44a4-8335-4aa84f4565b6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:45.655406 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-dc484461-51e6-44a4-8335-4aa84f4565b6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:45.655535 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-53a46fd1-0c0a-43f0-9732-e7da0f7c80d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:45.655908 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-53a46fd1-0c0a-43f0-9732-e7da0f7c80d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:45.784898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-53a46fd1-0c0a-43f0-9732-e7da0f7c80d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:45.792962 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-53a46fd1-0c0a-43f0-9732-e7da0f7c80d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:45.794456 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-53a46fd1-0c0a-43f0-9732-e7da0f7c80d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:45.795611 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-53a46fd1-0c0a-43f0-9732-e7da0f7c80d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.151946 Jun 16 21:17:45.796163 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 396/746] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:17:45 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:17:45.802423 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-dc484461-51e6-44a4-8335-4aa84f4565b6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:45.810264 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-dc484461-51e6-44a4-8335-4aa84f4565b6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.167387 Jun 16 21:17:45.810813 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 351/747] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:45 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:46.121919 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1f5bd99b-5592-4ef3-bc80-762083d1bb2f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:46.122531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1f5bd99b-5592-4ef3-bc80-762083d1bb2f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:46.129610 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1f5bd99b-5592-4ef3-bc80-762083d1bb2f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:46.130053 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1f5bd99b-5592-4ef3-bc80-762083d1bb2f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:46.130817 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1f5bd99b-5592-4ef3-bc80-762083d1bb2f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:46.131246 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1f5bd99b-5592-4ef3-bc80-762083d1bb2f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:46.159204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7dc5dd38-8780-4bf3-b9ef-263edd4c3391 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:46.159821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7dc5dd38-8780-4bf3-b9ef-263edd4c3391 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:46.166314 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7dc5dd38-8780-4bf3-b9ef-263edd4c3391 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:46.166679 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7dc5dd38-8780-4bf3-b9ef-263edd4c3391 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:46.167438 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7dc5dd38-8780-4bf3-b9ef-263edd4c3391 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:46.167858 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7dc5dd38-8780-4bf3-b9ef-263edd4c3391 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:46.265249 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1f5bd99b-5592-4ef3-bc80-762083d1bb2f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:46.274114 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1f5bd99b-5592-4ef3-bc80-762083d1bb2f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1677 microversion: 2.1 time: 0.156082 Jun 16 21:17:46.276382 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 397/748] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:46 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:46.315329 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-7dc5dd38-8780-4bf3-b9ef-263edd4c3391 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:46.323073 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7dc5dd38-8780-4bf3-b9ef-263edd4c3391 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.168232 Jun 16 21:17:46.323635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 352/749] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:46 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:46.817397 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-6fe15a65-9706-4213-b84f-f5681eb6326e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:46.818010 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-6fe15a65-9706-4213-b84f-f5681eb6326e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:46.824981 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6fe15a65-9706-4213-b84f-f5681eb6326e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:46.825775 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6fe15a65-9706-4213-b84f-f5681eb6326e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:46.826742 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6fe15a65-9706-4213-b84f-f5681eb6326e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:46.826879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-df403e0c-92f8-46e0-af2f-95692e1cc20f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:46.827179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6fe15a65-9706-4213-b84f-f5681eb6326e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:46.827987 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-df403e0c-92f8-46e0-af2f-95692e1cc20f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:46.836475 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-df403e0c-92f8-46e0-af2f-95692e1cc20f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:46.836933 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-df403e0c-92f8-46e0-af2f-95692e1cc20f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:46.838000 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-df403e0c-92f8-46e0-af2f-95692e1cc20f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:46.838795 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-df403e0c-92f8-46e0-af2f-95692e1cc20f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:46.967548 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6fe15a65-9706-4213-b84f-f5681eb6326e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:46.976232 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6fe15a65-9706-4213-b84f-f5681eb6326e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:46.977968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6fe15a65-9706-4213-b84f-f5681eb6326e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:46.979148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-6fe15a65-9706-4213-b84f-f5681eb6326e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.168334 Jun 16 21:17:46.979872 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 398/750] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:17:46 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:17:46.995300 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-df403e0c-92f8-46e0-af2f-95692e1cc20f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:47.004157 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-df403e0c-92f8-46e0-af2f-95692e1cc20f tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.181233 Jun 16 21:17:47.004766 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 353/751] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:46 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:47.294392 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-cc7463ff-3202-431a-8a5e-016d6441fc84 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:47.295013 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-cc7463ff-3202-431a-8a5e-016d6441fc84 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:47.301270 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cc7463ff-3202-431a-8a5e-016d6441fc84 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:47.301713 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cc7463ff-3202-431a-8a5e-016d6441fc84 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:47.302478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cc7463ff-3202-431a-8a5e-016d6441fc84 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:47.302910 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cc7463ff-3202-431a-8a5e-016d6441fc84 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:47.340514 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0ecc37b2-89c3-4e94-b846-17307e399e33 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:47.341119 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0ecc37b2-89c3-4e94-b846-17307e399e33 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:47.348289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0ecc37b2-89c3-4e94-b846-17307e399e33 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:47.348727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0ecc37b2-89c3-4e94-b846-17307e399e33 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:47.349490 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0ecc37b2-89c3-4e94-b846-17307e399e33 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:47.349912 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0ecc37b2-89c3-4e94-b846-17307e399e33 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:47.435730 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-cc7463ff-3202-431a-8a5e-016d6441fc84 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:47.445085 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-cc7463ff-3202-431a-8a5e-016d6441fc84 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1677 microversion: 2.1 time: 0.154482 Jun 16 21:17:47.445754 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 399/752] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:47 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:47.490011 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0ecc37b2-89c3-4e94-b846-17307e399e33 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:47.498691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0ecc37b2-89c3-4e94-b846-17307e399e33 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.161943 Jun 16 21:17:47.499265 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 354/753] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:47 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:47.997839 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-2a5c34d5-0890-490d-a163-123097e22fea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:47.998447 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-2a5c34d5-0890-490d-a163-123097e22fea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:48.005820 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2a5c34d5-0890-490d-a163-123097e22fea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:48.006259 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2a5c34d5-0890-490d-a163-123097e22fea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:48.007013 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2a5c34d5-0890-490d-a163-123097e22fea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:48.007441 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2a5c34d5-0890-490d-a163-123097e22fea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:48.021320 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-683ba5f7-16e5-4724-8cd3-90c999a642ce tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:48.021933 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-683ba5f7-16e5-4724-8cd3-90c999a642ce tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:48.027903 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-683ba5f7-16e5-4724-8cd3-90c999a642ce tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:48.028405 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-683ba5f7-16e5-4724-8cd3-90c999a642ce tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:48.029166 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-683ba5f7-16e5-4724-8cd3-90c999a642ce tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:48.029598 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-683ba5f7-16e5-4724-8cd3-90c999a642ce tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:48.142391 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2a5c34d5-0890-490d-a163-123097e22fea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:48.151147 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2a5c34d5-0890-490d-a163-123097e22fea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:48.152674 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2a5c34d5-0890-490d-a163-123097e22fea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:48.153845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-2a5c34d5-0890-490d-a163-123097e22fea tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.160084 Jun 16 21:17:48.154849 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 400/754] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:17:47 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:17:48.176435 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-683ba5f7-16e5-4724-8cd3-90c999a642ce tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:48.184369 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-683ba5f7-16e5-4724-8cd3-90c999a642ce tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.166810 Jun 16 21:17:48.184924 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 355/755] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:48 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:48.463556 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-46b12d7b-c5f9-44b3-9e37-a3f40251e18b tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:48.464079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-46b12d7b-c5f9-44b3-9e37-a3f40251e18b tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:48.470562 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-46b12d7b-c5f9-44b3-9e37-a3f40251e18b tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:48.470994 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-46b12d7b-c5f9-44b3-9e37-a3f40251e18b tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:48.471738 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-46b12d7b-c5f9-44b3-9e37-a3f40251e18b tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:48.472162 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-46b12d7b-c5f9-44b3-9e37-a3f40251e18b tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:48.516337 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3d32ab5f-3078-48f5-b9df-35bce26cd04e tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:48.516944 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-3d32ab5f-3078-48f5-b9df-35bce26cd04e tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:48.523265 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3d32ab5f-3078-48f5-b9df-35bce26cd04e tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:48.523706 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3d32ab5f-3078-48f5-b9df-35bce26cd04e tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:48.524484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3d32ab5f-3078-48f5-b9df-35bce26cd04e tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:48.524909 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3d32ab5f-3078-48f5-b9df-35bce26cd04e tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:48.608368 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-46b12d7b-c5f9-44b3-9e37-a3f40251e18b tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:48.616238 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-46b12d7b-c5f9-44b3-9e37-a3f40251e18b tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1654 microversion: 2.1 time: 0.156337 Jun 16 21:17:48.616821 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 401/756] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:48 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1654 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:48.632576 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5184eccd-a117-4398-844f-e4536f7c6383 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:48.638676 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5184eccd-a117-4398-844f-e4536f7c6383 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:48.639148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5184eccd-a117-4398-844f-e4536f7c6383 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:48.662507 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5184eccd-a117-4398-844f-e4536f7c6383 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Going to try to start instance {{(pid=117737) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 21:17:48.670929 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-3d32ab5f-3078-48f5-b9df-35bce26cd04e tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:48.678778 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-3d32ab5f-3078-48f5-b9df-35bce26cd04e tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.166437 Jun 16 21:17:48.679342 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 356/757] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:48 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:48.695684 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:48.705266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5184eccd-a117-4398-844f-e4536f7c6383 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "POST /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/action" status: 202 len: 0 microversion: 2.1 time: 0.076394 Jun 16 21:17:48.705861 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 402/758] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 16 21:17:48 2022] POST /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 21:17:48.713936 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-839fc551-f1ed-445e-b5e4-d8454608af57 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:48.714489 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-839fc551-f1ed-445e-b5e4-d8454608af57 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:48.721127 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-839fc551-f1ed-445e-b5e4-d8454608af57 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:48.721634 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-839fc551-f1ed-445e-b5e4-d8454608af57 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:48.722413 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-839fc551-f1ed-445e-b5e4-d8454608af57 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:48.722849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-839fc551-f1ed-445e-b5e4-d8454608af57 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:48.853905 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-839fc551-f1ed-445e-b5e4-d8454608af57 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:48.861524 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-839fc551-f1ed-445e-b5e4-d8454608af57 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1663 microversion: 2.1 time: 0.151382 Jun 16 21:17:48.862089 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 357/759] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:48 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:49.175736 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b4fef9ec-6771-491e-864e-01911f25a7d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:49.176461 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b4fef9ec-6771-491e-864e-01911f25a7d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:49.184613 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b4fef9ec-6771-491e-864e-01911f25a7d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:49.185053 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b4fef9ec-6771-491e-864e-01911f25a7d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:49.185812 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b4fef9ec-6771-491e-864e-01911f25a7d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:49.186240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b4fef9ec-6771-491e-864e-01911f25a7d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:49.202380 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-44bdd405-5b2f-4b87-acde-21516a9a95d8 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:49.203003 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-44bdd405-5b2f-4b87-acde-21516a9a95d8 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:49.209694 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-44bdd405-5b2f-4b87-acde-21516a9a95d8 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:49.210152 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-44bdd405-5b2f-4b87-acde-21516a9a95d8 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:49.210898 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-44bdd405-5b2f-4b87-acde-21516a9a95d8 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:49.211326 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-44bdd405-5b2f-4b87-acde-21516a9a95d8 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:49.324377 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b4fef9ec-6771-491e-864e-01911f25a7d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:49.335493 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b4fef9ec-6771-491e-864e-01911f25a7d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:49.337038 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b4fef9ec-6771-491e-864e-01911f25a7d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:49.338249 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b4fef9ec-6771-491e-864e-01911f25a7d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.167289 Jun 16 21:17:49.339147 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 403/760] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:17:49 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:17:49.365509 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-44bdd405-5b2f-4b87-acde-21516a9a95d8 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:49.373556 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-44bdd405-5b2f-4b87-acde-21516a9a95d8 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.175029 Jun 16 21:17:49.374102 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 358/761] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:49 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:49.695203 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-64f3d2ff-7ca6-4e78-9e2c-6dc64bf41c40 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:49.695839 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-64f3d2ff-7ca6-4e78-9e2c-6dc64bf41c40 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:49.701807 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-64f3d2ff-7ca6-4e78-9e2c-6dc64bf41c40 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:49.702247 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-64f3d2ff-7ca6-4e78-9e2c-6dc64bf41c40 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:49.702997 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-64f3d2ff-7ca6-4e78-9e2c-6dc64bf41c40 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:49.703649 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-64f3d2ff-7ca6-4e78-9e2c-6dc64bf41c40 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:49.830871 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-64f3d2ff-7ca6-4e78-9e2c-6dc64bf41c40 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:49.838242 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-64f3d2ff-7ca6-4e78-9e2c-6dc64bf41c40 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.146855 Jun 16 21:17:49.838802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 404/762] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:49 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:49.879247 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-80167d9f-5afb-47bf-95ea-d3b26d232d47 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:49.879797 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-80167d9f-5afb-47bf-95ea-d3b26d232d47 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:49.886083 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-80167d9f-5afb-47bf-95ea-d3b26d232d47 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:49.886522 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-80167d9f-5afb-47bf-95ea-d3b26d232d47 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:49.887270 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-80167d9f-5afb-47bf-95ea-d3b26d232d47 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:49.887697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-80167d9f-5afb-47bf-95ea-d3b26d232d47 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:50.013828 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-80167d9f-5afb-47bf-95ea-d3b26d232d47 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:50.021412 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-80167d9f-5afb-47bf-95ea-d3b26d232d47 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1663 microversion: 2.1 time: 0.146267 Jun 16 21:17:50.021973 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 359/763] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:49 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1663 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:50.355694 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-98344e6f-65a2-4170-80e0-10f1b225c971 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:50.356330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-98344e6f-65a2-4170-80e0-10f1b225c971 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:50.363362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-98344e6f-65a2-4170-80e0-10f1b225c971 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:50.363806 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-98344e6f-65a2-4170-80e0-10f1b225c971 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:50.364611 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-98344e6f-65a2-4170-80e0-10f1b225c971 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:50.365043 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-98344e6f-65a2-4170-80e0-10f1b225c971 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:50.391798 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-73d5f09f-a326-477e-b42d-750903d28901 req-c143fa96-b8fa-4aee-ab4a-121c20996c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329313fc-d559-41c6-9dad-471e57c9751e", "name": "network-vif-unplugged", "status": "completed", "tag": "dbb3b245-c7c5-45cc-8bc9-e46efbfd90bb"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:50.400600 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-73d5f09f-a326-477e-b42d-750903d28901 req-c143fa96-b8fa-4aee-ab4a-121c20996c4d service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:50.401036 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-73d5f09f-a326-477e-b42d-750903d28901 req-c143fa96-b8fa-4aee-ab4a-121c20996c4d service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:50.413726 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-73d5f09f-a326-477e-b42d-750903d28901 req-c143fa96-b8fa-4aee-ab4a-121c20996c4d service nova] Creating event network-vif-unplugged:dbb3b245-c7c5-45cc-8bc9-e46efbfd90bb for instance 329313fc-d559-41c6-9dad-471e57c9751e on hv-cinder-81914 Jun 16 21:17:50.418840 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-73d5f09f-a326-477e-b42d-750903d28901 req-c143fa96-b8fa-4aee-ab4a-121c20996c4d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031777 Jun 16 21:17:50.419615 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 360/764] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:17:50.424451 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-10d38c86-76ae-448d-a8b4-10fb6f13efb4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:50.425143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-10d38c86-76ae-448d-a8b4-10fb6f13efb4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:50.431898 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-10d38c86-76ae-448d-a8b4-10fb6f13efb4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:50.432706 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-10d38c86-76ae-448d-a8b4-10fb6f13efb4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:50.433131 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-10d38c86-76ae-448d-a8b4-10fb6f13efb4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:50.433563 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-10d38c86-76ae-448d-a8b4-10fb6f13efb4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:50.508010 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-98344e6f-65a2-4170-80e0-10f1b225c971 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:50.516997 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-98344e6f-65a2-4170-80e0-10f1b225c971 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:50.518410 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-98344e6f-65a2-4170-80e0-10f1b225c971 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:50.519608 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-98344e6f-65a2-4170-80e0-10f1b225c971 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.167792 Jun 16 21:17:50.520192 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 405/765] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:17:50 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:17:50.582219 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-10d38c86-76ae-448d-a8b4-10fb6f13efb4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:50.590194 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-10d38c86-76ae-448d-a8b4-10fb6f13efb4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.169618 Jun 16 21:17:50.590759 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 361/766] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:50 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:50.854760 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e4471c0a-ffb9-4834-bc42-bc8b876404c3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:50.855414 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e4471c0a-ffb9-4834-bc42-bc8b876404c3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:50.862064 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e4471c0a-ffb9-4834-bc42-bc8b876404c3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:50.862508 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e4471c0a-ffb9-4834-bc42-bc8b876404c3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:50.863263 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e4471c0a-ffb9-4834-bc42-bc8b876404c3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:50.863693 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e4471c0a-ffb9-4834-bc42-bc8b876404c3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:50.995453 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e4471c0a-ffb9-4834-bc42-bc8b876404c3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:51.003476 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e4471c0a-ffb9-4834-bc42-bc8b876404c3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.152558 Jun 16 21:17:51.004036 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 406/767] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:50 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:51.038024 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b1c59496-207d-41ae-b8ff-c4f168f68cef tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:51.038636 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b1c59496-207d-41ae-b8ff-c4f168f68cef tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:51.045051 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b1c59496-207d-41ae-b8ff-c4f168f68cef tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:51.045498 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b1c59496-207d-41ae-b8ff-c4f168f68cef tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:51.046258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b1c59496-207d-41ae-b8ff-c4f168f68cef tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:51.046690 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b1c59496-207d-41ae-b8ff-c4f168f68cef tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:51.061999 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:51.181469 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b1c59496-207d-41ae-b8ff-c4f168f68cef tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:51.189611 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b1c59496-207d-41ae-b8ff-c4f168f68cef tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1663 microversion: 2.1 time: 0.155356 Jun 16 21:17:51.190162 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 362/768] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:51 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:51.538340 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b7da63da-d079-4685-986c-026f3586c29e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:51.538958 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b7da63da-d079-4685-986c-026f3586c29e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:51.545510 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b7da63da-d079-4685-986c-026f3586c29e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:51.545957 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b7da63da-d079-4685-986c-026f3586c29e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:51.546733 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b7da63da-d079-4685-986c-026f3586c29e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:51.547886 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b7da63da-d079-4685-986c-026f3586c29e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:51.606724 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3beebb89-49e0-4dfc-a149-27440c463599 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:51.607334 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-3beebb89-49e0-4dfc-a149-27440c463599 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:51.614778 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3beebb89-49e0-4dfc-a149-27440c463599 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:51.615688 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3beebb89-49e0-4dfc-a149-27440c463599 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:51.616930 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3beebb89-49e0-4dfc-a149-27440c463599 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:51.617373 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3beebb89-49e0-4dfc-a149-27440c463599 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:51.715815 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b7da63da-d079-4685-986c-026f3586c29e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:51.727178 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b7da63da-d079-4685-986c-026f3586c29e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:51.729153 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b7da63da-d079-4685-986c-026f3586c29e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:51.730368 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b7da63da-d079-4685-986c-026f3586c29e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.195943 Jun 16 21:17:51.731497 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 407/769] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:17:51 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:17:51.803078 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-3beebb89-49e0-4dfc-a149-27440c463599 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:51.811213 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-3beebb89-49e0-4dfc-a149-27440c463599 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1757 microversion: 2.1 time: 0.208264 Jun 16 21:17:51.811774 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 363/770] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:51 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:52.020651 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-cd3d75dd-1c67-40d2-8886-87d00e396564 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:52.021268 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-cd3d75dd-1c67-40d2-8886-87d00e396564 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:52.027404 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cd3d75dd-1c67-40d2-8886-87d00e396564 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:52.027859 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cd3d75dd-1c67-40d2-8886-87d00e396564 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:52.028724 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cd3d75dd-1c67-40d2-8886-87d00e396564 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:52.029160 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cd3d75dd-1c67-40d2-8886-87d00e396564 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:52.167749 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-cd3d75dd-1c67-40d2-8886-87d00e396564 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:52.175839 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-cd3d75dd-1c67-40d2-8886-87d00e396564 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.158921 Jun 16 21:17:52.176363 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 408/771] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:52 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:52.207137 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-cd2bde31-2390-452a-b0c0-8bf1353e054c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:52.207742 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-cd2bde31-2390-452a-b0c0-8bf1353e054c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:52.214200 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cd2bde31-2390-452a-b0c0-8bf1353e054c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:52.214636 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cd2bde31-2390-452a-b0c0-8bf1353e054c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:52.215385 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cd2bde31-2390-452a-b0c0-8bf1353e054c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:52.215813 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cd2bde31-2390-452a-b0c0-8bf1353e054c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:52.351290 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-cd2bde31-2390-452a-b0c0-8bf1353e054c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:52.360511 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-cd2bde31-2390-452a-b0c0-8bf1353e054c tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1663 microversion: 2.1 time: 0.156733 Jun 16 21:17:52.361104 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 364/772] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:52 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:52.750102 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0d912777-9e4a-4adf-b14f-c0cb0d03a63c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:52.751314 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0d912777-9e4a-4adf-b14f-c0cb0d03a63c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:52.761036 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0d912777-9e4a-4adf-b14f-c0cb0d03a63c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:52.761564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0d912777-9e4a-4adf-b14f-c0cb0d03a63c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:52.762506 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0d912777-9e4a-4adf-b14f-c0cb0d03a63c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:52.762932 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0d912777-9e4a-4adf-b14f-c0cb0d03a63c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:52.830335 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5c13ff29-90d1-4b06-951d-56b21940e12e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:52.830955 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5c13ff29-90d1-4b06-951d-56b21940e12e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:52.840289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5c13ff29-90d1-4b06-951d-56b21940e12e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:52.840827 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5c13ff29-90d1-4b06-951d-56b21940e12e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:52.841845 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5c13ff29-90d1-4b06-951d-56b21940e12e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:52.842412 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5c13ff29-90d1-4b06-951d-56b21940e12e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:53.001429 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5c13ff29-90d1-4b06-951d-56b21940e12e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:53.009397 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5c13ff29-90d1-4b06-951d-56b21940e12e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1760 microversion: 2.1 time: 0.183884 Jun 16 21:17:53.013404 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 365/773] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:52 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1760 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:53.084352 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0d912777-9e4a-4adf-b14f-c0cb0d03a63c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:53.092964 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0d912777-9e4a-4adf-b14f-c0cb0d03a63c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:53.095261 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0d912777-9e4a-4adf-b14f-c0cb0d03a63c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:53.097442 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0d912777-9e4a-4adf-b14f-c0cb0d03a63c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1721 microversion: 2.20 time: 0.351481 Jun 16 21:17:53.098011 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 409/774] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:17:52 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1721 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:17:53.194692 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-e847820f-db0e-454c-8331-a29f029ea643 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:53.195627 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-e847820f-db0e-454c-8331-a29f029ea643 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:53.202082 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e847820f-db0e-454c-8331-a29f029ea643 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:53.202843 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e847820f-db0e-454c-8331-a29f029ea643 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:53.205088 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e847820f-db0e-454c-8331-a29f029ea643 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:53.205558 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e847820f-db0e-454c-8331-a29f029ea643 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:53.379160 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0bb01bb1-d62d-4ebb-8b99-da543aa972cb tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:53.379869 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0bb01bb1-d62d-4ebb-8b99-da543aa972cb tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:53.386962 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-e847820f-db0e-454c-8331-a29f029ea643 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:53.394586 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0bb01bb1-d62d-4ebb-8b99-da543aa972cb tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:53.395027 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0bb01bb1-d62d-4ebb-8b99-da543aa972cb tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:53.395548 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-e847820f-db0e-454c-8331-a29f029ea643 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1567 microversion: 2.1 time: 0.206011 Jun 16 21:17:53.396504 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 366/775] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:53 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:53.396896 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0bb01bb1-d62d-4ebb-8b99-da543aa972cb tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:53.397337 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0bb01bb1-d62d-4ebb-8b99-da543aa972cb tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:53.412938 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d9443010-b791-41cb-8cbe-357f0b612290 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:53.413867 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d9443010-b791-41cb-8cbe-357f0b612290 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:53.420931 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9443010-b791-41cb-8cbe-357f0b612290 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:53.421483 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9443010-b791-41cb-8cbe-357f0b612290 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:53.422799 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9443010-b791-41cb-8cbe-357f0b612290 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:53.423304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d9443010-b791-41cb-8cbe-357f0b612290 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:53.505839 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d9443010-b791-41cb-8cbe-357f0b612290 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "POST /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e/action" status: 202 len: 0 microversion: 2.1 time: 0.097073 Jun 16 21:17:53.506543 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 367/776] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 16 21:17:53 2022] POST /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 21:17:53.514667 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7a9c13de-d4d6-41b6-ad1b-ab6df01660be tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:53.515227 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7a9c13de-d4d6-41b6-ad1b-ab6df01660be tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:53.521818 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7a9c13de-d4d6-41b6-ad1b-ab6df01660be tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:53.522268 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7a9c13de-d4d6-41b6-ad1b-ab6df01660be tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:53.523053 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7a9c13de-d4d6-41b6-ad1b-ab6df01660be tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:53.523492 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7a9c13de-d4d6-41b6-ad1b-ab6df01660be tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:53.693125 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-7a9c13de-d4d6-41b6-ad1b-ab6df01660be tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:53.701322 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7a9c13de-d4d6-41b6-ad1b-ab6df01660be tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1515 microversion: 2.1 time: 0.190542 Jun 16 21:17:53.702097 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 368/777] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:53 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:53.974226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0bb01bb1-d62d-4ebb-8b99-da543aa972cb tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:53.982404 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0bb01bb1-d62d-4ebb-8b99-da543aa972cb tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1663 microversion: 2.1 time: 0.608430 Jun 16 21:17:53.983183 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 410/778] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:53 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1663 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:17:54.119012 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8de3a5e7-dfdb-4c54-a57e-fb03d7e80a88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:54.120300 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8de3a5e7-dfdb-4c54-a57e-fb03d7e80a88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:54.131023 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8de3a5e7-dfdb-4c54-a57e-fb03d7e80a88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:54.131723 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8de3a5e7-dfdb-4c54-a57e-fb03d7e80a88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:54.132541 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8de3a5e7-dfdb-4c54-a57e-fb03d7e80a88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:54.132978 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8de3a5e7-dfdb-4c54-a57e-fb03d7e80a88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:54.191741 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-2602dbfc-5619-410e-8ef6-33b2742d9c71 req-f468bac2-987b-4797-abed-1446d2c49b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2281b8c3-ec1f-478b-bd50-128d5cf67a04", "name": "network-vif-deleted", "tag": "6473309c-d2e4-42b4-94b1-6b373a5e59f2"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:54.199792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-2602dbfc-5619-410e-8ef6-33b2742d9c71 req-f468bac2-987b-4797-abed-1446d2c49b7f service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:54.200265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-2602dbfc-5619-410e-8ef6-33b2742d9c71 req-f468bac2-987b-4797-abed-1446d2c49b7f service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:54.209775 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8de3a5e7-dfdb-4c54-a57e-fb03d7e80a88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:54.213507 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-2602dbfc-5619-410e-8ef6-33b2742d9c71 req-f468bac2-987b-4797-abed-1446d2c49b7f service nova] Creating event network-vif-deleted:6473309c-d2e4-42b4-94b1-6b373a5e59f2 for instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 on hv-cinder-81914 Jun 16 21:17:54.219899 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-2602dbfc-5619-410e-8ef6-33b2742d9c71 req-f468bac2-987b-4797-abed-1446d2c49b7f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031924 Jun 16 21:17:54.221175 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 411/779] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:17:54.221852 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8de3a5e7-dfdb-4c54-a57e-fb03d7e80a88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:54.223827 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8de3a5e7-dfdb-4c54-a57e-fb03d7e80a88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:54.225065 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8de3a5e7-dfdb-4c54-a57e-fb03d7e80a88 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1653 microversion: 2.20 time: 0.112503 Jun 16 21:17:54.235721 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 369/780] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:17:54 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1653 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:17:54.720047 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d936e84a-e3eb-4d0b-ae59-a63f8ea12b6e tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:54.720782 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d936e84a-e3eb-4d0b-ae59-a63f8ea12b6e tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:54.726875 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d936e84a-e3eb-4d0b-ae59-a63f8ea12b6e tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:54.727386 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d936e84a-e3eb-4d0b-ae59-a63f8ea12b6e tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:54.728257 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d936e84a-e3eb-4d0b-ae59-a63f8ea12b6e tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:54.728754 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d936e84a-e3eb-4d0b-ae59-a63f8ea12b6e tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:54.877127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d936e84a-e3eb-4d0b-ae59-a63f8ea12b6e tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:54.884843 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d936e84a-e3eb-4d0b-ae59-a63f8ea12b6e tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1517 microversion: 2.1 time: 0.169589 Jun 16 21:17:54.885416 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 412/781] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:54 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:55.000595 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-668171de-cbfd-474d-8030-a289f9642524 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:55.001661 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-668171de-cbfd-474d-8030-a289f9642524 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:55.007972 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-668171de-cbfd-474d-8030-a289f9642524 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:55.008624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-668171de-cbfd-474d-8030-a289f9642524 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:55.009508 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-668171de-cbfd-474d-8030-a289f9642524 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:55.010009 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-668171de-cbfd-474d-8030-a289f9642524 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:55.143790 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-668171de-cbfd-474d-8030-a289f9642524 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:55.151628 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-668171de-cbfd-474d-8030-a289f9642524 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1667 microversion: 2.1 time: 0.155533 Jun 16 21:17:55.152240 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 370/782] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:54 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:55.244802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4f433ba9-aff4-43cd-b266-eb600ba2d547 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:55.245414 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4f433ba9-aff4-43cd-b266-eb600ba2d547 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:55.252146 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f433ba9-aff4-43cd-b266-eb600ba2d547 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:55.252618 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f433ba9-aff4-43cd-b266-eb600ba2d547 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:55.253378 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f433ba9-aff4-43cd-b266-eb600ba2d547 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:55.253808 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f433ba9-aff4-43cd-b266-eb600ba2d547 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:55.283891 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f433ba9-aff4-43cd-b266-eb600ba2d547 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:55.284353 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f433ba9-aff4-43cd-b266-eb600ba2d547 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:55.284798 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.objects.instance [None req-4f433ba9-aff4-43cd-b266-eb600ba2d547 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lazy-loading 'fault' on Instance uuid 2281b8c3-ec1f-478b-bd50-128d5cf67a04 {{(pid=117737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:17:55.325718 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4f433ba9-aff4-43cd-b266-eb600ba2d547 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:55.333668 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4f433ba9-aff4-43cd-b266-eb600ba2d547 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:55.335169 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4f433ba9-aff4-43cd-b266-eb600ba2d547 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:55.336346 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4f433ba9-aff4-43cd-b266-eb600ba2d547 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 200 len: 1370 microversion: 2.20 time: 0.095682 Jun 16 21:17:55.336907 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 413/783] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:17:55 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 1370 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:17:55.902354 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8bc1e07e-5cf0-4a6a-9dae-be948980dcc4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:55.903076 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8bc1e07e-5cf0-4a6a-9dae-be948980dcc4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:55.910464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8bc1e07e-5cf0-4a6a-9dae-be948980dcc4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:55.910905 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8bc1e07e-5cf0-4a6a-9dae-be948980dcc4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:55.911819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8bc1e07e-5cf0-4a6a-9dae-be948980dcc4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:55.912281 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8bc1e07e-5cf0-4a6a-9dae-be948980dcc4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:56.047573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8bc1e07e-5cf0-4a6a-9dae-be948980dcc4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:56.055109 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8bc1e07e-5cf0-4a6a-9dae-be948980dcc4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1573 microversion: 2.1 time: 0.156599 Jun 16 21:17:56.055679 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 371/784] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:55 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:56.354466 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d3e04422-56c6-4bed-8240-4b4671c18382 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:56.355207 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d3e04422-56c6-4bed-8240-4b4671c18382 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:56.362069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d3e04422-56c6-4bed-8240-4b4671c18382 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:56.362516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d3e04422-56c6-4bed-8240-4b4671c18382 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:56.363468 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d3e04422-56c6-4bed-8240-4b4671c18382 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:56.363902 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d3e04422-56c6-4bed-8240-4b4671c18382 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:56.377629 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-d3e04422-56c6-4bed-8240-4b4671c18382 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] HTTP exception thrown: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d3e04422-56c6-4bed-8240-4b4671c18382 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Request method failure captured: Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 HTTP/1.1 Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5zk364JTme2zchNS_wRkzhgAVUFjYPIp8nqeDxTS3rFd_cu023F9oDuseuPiqoLxVQ9yNiyTqa7XJ7xJSmJ9WrLK7OVnEPTIrtAILHPclyn5wAtxcylAXIYh6DqvCQiQUEtZ81f2rtCDB7NJ1L1c6bG5Hk1Xp6dQsweJ484rLN1fEg Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 8fd2e5ab99c341d38c3f78dc17c0faf2 Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:17:56.379289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:17:56.380897 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}] Jun 16 21:17:56.380897 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:17:56.380897 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 8fd2e5ab99c341d38c3f78dc17c0faf2 Jun 16 21:17:56.380897 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:17:56.380897 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-AttachVolumeShelveTestJSON-356244796-project Jun 16 21:17:56.380897 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:17:56.380897 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:17:56.380897 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 8cc395fc4407473e9595bc99c6b6b36c Jun 16 21:17:56.380897 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-AttachVolumeShelveTestJSON-356244796-project Jun 16 21:17:56.380897 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:17:56.380897 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. Jun 16 21:17:56.380897 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '2281b8c3-ec1f-478b-bd50-128d5cf67a04'} Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:17:56.381960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. Jun 16 21:17:56.383547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:17:56.386515 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d3e04422-56c6-4bed-8240-4b4671c18382 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Returning 404 to user: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:17:56.386515 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d3e04422-56c6-4bed-8240-4b4671c18382 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 404 len: 111 microversion: 2.20 time: 0.030170 Jun 16 21:17:56.386515 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 414/785] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:17:56 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 21:17:56.391310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6fd50ba9-8540-462a-92a2-66c6db7fec4a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '.version_select at 0x7fb3f74915e0>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:56.403248 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:56.412210 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6fd50ba9-8540-462a-92a2-66c6db7fec4a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-724510636" status: 204 len: 0 microversion: 2.20 time: 0.024654 Jun 16 21:17:56.413006 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 372/786] 10.222.0.43 () {60 vars in 1258 bytes} [Thu Jun 16 21:17:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-724510636 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 21:17:57.072967 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4e3bc324-9d92-4db1-a004-3c6f9ad5633a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:57.073588 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4e3bc324-9d92-4db1-a004-3c6f9ad5633a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:57.080831 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4e3bc324-9d92-4db1-a004-3c6f9ad5633a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:57.081887 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4e3bc324-9d92-4db1-a004-3c6f9ad5633a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:57.082895 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4e3bc324-9d92-4db1-a004-3c6f9ad5633a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:57.083034 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c01acc11-dbed-4ac1-9217-3f87dd8419d0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Action: 'create', calling method: .version_select at 0x7fb3f771dd30>, body: {"keypair": {"name": "tempest-keypair-1568301273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQrnaZtjTVQXWlhYf9F3frzGdzRHZVM9ZW+xjNnrZp6huaRthdLJLttlqMqEpVBBTARk6tYTIf6QaGC+o+mJbz7cWPTW9isjOCQVeCsxslguM3mCuRK3bmo2vxELlcBjg=="}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:57.083487 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4e3bc324-9d92-4db1-a004-3c6f9ad5633a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:57.097761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-c01acc11-dbed-4ac1-9217-3f87dd8419d0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Getting quotas for project 8fd2e5ab99c341d38c3f78dc17c0faf2. Resources: {'key_pairs'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:17:57.101793 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-c01acc11-dbed-4ac1-9217-3f87dd8419d0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Getting quotas for user 8cc395fc4407473e9595bc99c6b6b36c and project 8fd2e5ab99c341d38c3f78dc17c0faf2. Resources: {'key_pairs'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:17:57.130048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c01acc11-dbed-4ac1-9217-3f87dd8419d0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051399 Jun 16 21:17:57.130923 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 373/787] 10.222.0.43 () {62 vars in 1199 bytes} [Thu Jun 16 21:17:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 16 21:17:57.441497 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4e3bc324-9d92-4db1-a004-3c6f9ad5633a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:57.452615 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4e3bc324-9d92-4db1-a004-3c6f9ad5633a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1573 microversion: 2.1 time: 0.381971 Jun 16 21:17:57.453346 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 415/788] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:57 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1573 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:58.470458 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-deeb5d45-3444-44db-91c5-9756c19d547a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:58.471264 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c48b099c-c2de-445b-b296-ca89134e63ae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-976665011", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f15db21b-4597-49e4-b0f9-2724f76cadbd"}], "security_groups": [{"name": "tempest-securitygroup--545784527"}], "key_name": "tempest-keypair-1568301273", "user_data": "}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:17:58.471884 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-deeb5d45-3444-44db-91c5-9756c19d547a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:58.478358 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-deeb5d45-3444-44db-91c5-9756c19d547a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:58.478802 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-deeb5d45-3444-44db-91c5-9756c19d547a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:58.479561 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-deeb5d45-3444-44db-91c5-9756c19d547a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:58.479987 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-deeb5d45-3444-44db-91c5-9756c19d547a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:58.581799 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.network.neutron [None req-c48b099c-c2de-445b-b296-ca89134e63ae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] validate_networks() for [('f15db21b-4597-49e4-b0f9-2724f76cadbd', None, None, None, None, None)] {{(pid=117737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:17:58.787246 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-deeb5d45-3444-44db-91c5-9756c19d547a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:58.795924 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-deeb5d45-3444-44db-91c5-9756c19d547a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1573 microversion: 2.1 time: 0.329564 Jun 16 21:17:58.796614 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 374/789] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:58 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1573 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:17:58.961547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-c48b099c-c2de-445b-b296-ca89134e63ae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Flavor limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:17:58.961968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-c48b099c-c2de-445b-b296-ca89134e63ae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Image limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:17:58.962468 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-c48b099c-c2de-445b-b296-ca89134e63ae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Flavor pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:17:58.962905 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-c48b099c-c2de-445b-b296-ca89134e63ae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Image pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:17:58.963313 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-c48b099c-c2de-445b-b296-ca89134e63ae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:17:58.971948 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c48b099c-c2de-445b-b296-ca89134e63ae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:58.972428 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c48b099c-c2de-445b-b296-ca89134e63ae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:58.973224 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c48b099c-c2de-445b-b296-ca89134e63ae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:58.973654 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c48b099c-c2de-445b-b296-ca89134e63ae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:58.990370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-c48b099c-c2de-445b-b296-ca89134e63ae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Getting quotas for project 8fd2e5ab99c341d38c3f78dc17c0faf2. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:17:58.994499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-c48b099c-c2de-445b-b296-ca89134e63ae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Getting quotas for user 8cc395fc4407473e9595bc99c6b6b36c and project 8fd2e5ab99c341d38c3f78dc17c0faf2. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:17:59.005823 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c48b099c-c2de-445b-b296-ca89134e63ae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Going to run 1 instances... {{(pid=117737) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:17:59.008031 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c48b099c-c2de-445b-b296-ca89134e63ae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:17:59.054300 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c48b099c-c2de-445b-b296-ca89134e63ae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.587768 Jun 16 21:17:59.055146 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 416/790] 10.222.0.43 () {62 vars in 1187 bytes} [Thu Jun 16 21:17:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 16 21:17:59.065274 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0c3b68bc-54ba-4e5f-b497-44b7f4758ceb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:59.065865 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0c3b68bc-54ba-4e5f-b497-44b7f4758ceb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:59.118698 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0c3b68bc-54ba-4e5f-b497-44b7f4758ceb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:59.125991 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0c3b68bc-54ba-4e5f-b497-44b7f4758ceb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:59.127649 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0c3b68bc-54ba-4e5f-b497-44b7f4758ceb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:59.128787 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0c3b68bc-54ba-4e5f-b497-44b7f4758ceb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1281 microversion: 2.20 time: 0.067481 Jun 16 21:17:59.129356 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 375/791] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:17:59 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:17:59.814059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f9126717-f1fb-46fb-86bc-370331235612 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:17:59.814675 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f9126717-f1fb-46fb-86bc-370331235612 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:17:59.821395 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f9126717-f1fb-46fb-86bc-370331235612 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:59.821841 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f9126717-f1fb-46fb-86bc-370331235612 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:59.822609 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f9126717-f1fb-46fb-86bc-370331235612 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:17:59.823046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f9126717-f1fb-46fb-86bc-370331235612 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:17:59.961980 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f9126717-f1fb-46fb-86bc-370331235612 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:17:59.970563 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f9126717-f1fb-46fb-86bc-370331235612 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1573 microversion: 2.1 time: 0.160499 Jun 16 21:17:59.971166 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 417/792] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:17:59 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:00.148204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-755daaf9-38fd-41c8-a1dd-817e51b02ab1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:00.149049 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-755daaf9-38fd-41c8-a1dd-817e51b02ab1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:00.155474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-755daaf9-38fd-41c8-a1dd-817e51b02ab1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:00.155917 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-755daaf9-38fd-41c8-a1dd-817e51b02ab1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:00.156861 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-755daaf9-38fd-41c8-a1dd-817e51b02ab1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:00.158531 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-755daaf9-38fd-41c8-a1dd-817e51b02ab1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:00.222604 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-755daaf9-38fd-41c8-a1dd-817e51b02ab1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:00.230515 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-755daaf9-38fd-41c8-a1dd-817e51b02ab1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:00.232008 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-755daaf9-38fd-41c8-a1dd-817e51b02ab1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:00.233133 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-755daaf9-38fd-41c8-a1dd-817e51b02ab1 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1339 microversion: 2.20 time: 0.089456 Jun 16 21:18:00.233677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 376/793] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:18:00 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1339 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:18:00.987572 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4f0e3f4d-b071-4e81-b152-442c73d75d12 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:00.988372 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4f0e3f4d-b071-4e81-b152-442c73d75d12 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:00.994870 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f0e3f4d-b071-4e81-b152-442c73d75d12 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:00.995322 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f0e3f4d-b071-4e81-b152-442c73d75d12 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:00.996088 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f0e3f4d-b071-4e81-b152-442c73d75d12 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:00.996552 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4f0e3f4d-b071-4e81-b152-442c73d75d12 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:01.193236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4f0e3f4d-b071-4e81-b152-442c73d75d12 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:01.202041 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4f0e3f4d-b071-4e81-b152-442c73d75d12 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1573 microversion: 2.1 time: 0.218813 Jun 16 21:18:01.202613 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 418/794] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:00 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1573 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:01.252222 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4abfac87-2f10-4bfb-98ae-a83e95c384d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:01.254097 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4abfac87-2f10-4bfb-98ae-a83e95c384d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:01.262834 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4abfac87-2f10-4bfb-98ae-a83e95c384d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:01.263391 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4abfac87-2f10-4bfb-98ae-a83e95c384d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:01.264300 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4abfac87-2f10-4bfb-98ae-a83e95c384d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:01.264944 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4abfac87-2f10-4bfb-98ae-a83e95c384d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:01.410629 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4abfac87-2f10-4bfb-98ae-a83e95c384d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:01.421403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4abfac87-2f10-4bfb-98ae-a83e95c384d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:01.424341 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4abfac87-2f10-4bfb-98ae-a83e95c384d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:01.425598 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4abfac87-2f10-4bfb-98ae-a83e95c384d8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1406 microversion: 2.20 time: 0.178486 Jun 16 21:18:01.426346 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 377/795] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:18:01 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:18:01.473490 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-4e7e0eaa-16a0-423e-8f3d-38158947f8dc req-67d24b04-9751-4aa7-95c9-2d05fd82939a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a1b5610-fa96-44cf-b05b-41a354370d1c", "tag": "ce808840-2e04-4b62-89bc-caeba961a739"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:01.482684 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-4e7e0eaa-16a0-423e-8f3d-38158947f8dc req-67d24b04-9751-4aa7-95c9-2d05fd82939a service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:01.483131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-4e7e0eaa-16a0-423e-8f3d-38158947f8dc req-67d24b04-9751-4aa7-95c9-2d05fd82939a service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:01.495801 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-4e7e0eaa-16a0-423e-8f3d-38158947f8dc req-67d24b04-9751-4aa7-95c9-2d05fd82939a service nova] Creating event network-changed:ce808840-2e04-4b62-89bc-caeba961a739 for instance 6a1b5610-fa96-44cf-b05b-41a354370d1c on hv-cinder-81914 Jun 16 21:18:01.501763 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-4e7e0eaa-16a0-423e-8f3d-38158947f8dc req-67d24b04-9751-4aa7-95c9-2d05fd82939a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031741 Jun 16 21:18:01.502770 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 419/796] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:02.218804 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-78793130-d260-4194-9a2b-43bedc5043a0 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:02.219421 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-78793130-d260-4194-9a2b-43bedc5043a0 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:02.225575 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-78793130-d260-4194-9a2b-43bedc5043a0 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:02.226023 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-78793130-d260-4194-9a2b-43bedc5043a0 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:02.226792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-78793130-d260-4194-9a2b-43bedc5043a0 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:02.227225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-78793130-d260-4194-9a2b-43bedc5043a0 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:02.355067 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-78793130-d260-4194-9a2b-43bedc5043a0 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:02.362602 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-78793130-d260-4194-9a2b-43bedc5043a0 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1573 microversion: 2.1 time: 0.147648 Jun 16 21:18:02.363159 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 378/797] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:02 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:02.445169 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1c24746e-2b79-42a2-bf9c-a71322715dd7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:02.445854 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1c24746e-2b79-42a2-bf9c-a71322715dd7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:02.447735 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:02.453039 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1c24746e-2b79-42a2-bf9c-a71322715dd7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:02.453477 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1c24746e-2b79-42a2-bf9c-a71322715dd7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:02.454436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1c24746e-2b79-42a2-bf9c-a71322715dd7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:02.454873 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1c24746e-2b79-42a2-bf9c-a71322715dd7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:02.584496 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1c24746e-2b79-42a2-bf9c-a71322715dd7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:02.592367 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1c24746e-2b79-42a2-bf9c-a71322715dd7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:02.593873 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1c24746e-2b79-42a2-bf9c-a71322715dd7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:02.594999 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1c24746e-2b79-42a2-bf9c-a71322715dd7 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1406 microversion: 2.20 time: 0.154589 Jun 16 21:18:02.595552 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 420/798] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:18:02 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:18:03.379109 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a10c715d-ffd9-421f-89a1-385cb47ed9d7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:03.379718 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a10c715d-ffd9-421f-89a1-385cb47ed9d7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:03.386188 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a10c715d-ffd9-421f-89a1-385cb47ed9d7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:03.386632 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a10c715d-ffd9-421f-89a1-385cb47ed9d7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:03.387393 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a10c715d-ffd9-421f-89a1-385cb47ed9d7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:03.387824 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a10c715d-ffd9-421f-89a1-385cb47ed9d7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:03.613138 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8c6fcb3e-f52e-46c8-af86-6a88da173f45 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:03.613760 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8c6fcb3e-f52e-46c8-af86-6a88da173f45 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:03.620928 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8c6fcb3e-f52e-46c8-af86-6a88da173f45 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:03.621378 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8c6fcb3e-f52e-46c8-af86-6a88da173f45 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:03.622156 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8c6fcb3e-f52e-46c8-af86-6a88da173f45 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:03.622592 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8c6fcb3e-f52e-46c8-af86-6a88da173f45 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:03.758774 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a10c715d-ffd9-421f-89a1-385cb47ed9d7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:03.764745 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8c6fcb3e-f52e-46c8-af86-6a88da173f45 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:03.768198 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a10c715d-ffd9-421f-89a1-385cb47ed9d7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1573 microversion: 2.1 time: 0.391955 Jun 16 21:18:03.768787 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 379/799] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:03 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1573 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:03.770236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=100 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:03.776040 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8c6fcb3e-f52e-46c8-af86-6a88da173f45 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:03.777743 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8c6fcb3e-f52e-46c8-af86-6a88da173f45 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:03.778861 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8c6fcb3e-f52e-46c8-af86-6a88da173f45 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1406 microversion: 2.20 time: 0.169819 Jun 16 21:18:03.779569 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 421/800] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:18:03 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:18:04.786828 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d4e2e692-0333-457d-84bb-963ddfe633d2 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:04.788069 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d4e2e692-0333-457d-84bb-963ddfe633d2 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:04.796808 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d4e2e692-0333-457d-84bb-963ddfe633d2 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:04.798674 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e1d9009e-5672-49ba-a765-c2c4cbd7abd3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:04.799157 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d4e2e692-0333-457d-84bb-963ddfe633d2 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:04.799949 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d4e2e692-0333-457d-84bb-963ddfe633d2 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:04.800415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d4e2e692-0333-457d-84bb-963ddfe633d2 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:04.800618 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e1d9009e-5672-49ba-a765-c2c4cbd7abd3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:04.810073 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e1d9009e-5672-49ba-a765-c2c4cbd7abd3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:04.811006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e1d9009e-5672-49ba-a765-c2c4cbd7abd3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:04.811996 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e1d9009e-5672-49ba-a765-c2c4cbd7abd3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:04.812720 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e1d9009e-5672-49ba-a765-c2c4cbd7abd3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:04.945905 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e1d9009e-5672-49ba-a765-c2c4cbd7abd3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:04.946643 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d4e2e692-0333-457d-84bb-963ddfe633d2 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:04.954462 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e1d9009e-5672-49ba-a765-c2c4cbd7abd3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:04.954701 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d4e2e692-0333-457d-84bb-963ddfe633d2 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1573 microversion: 2.1 time: 0.173047 Jun 16 21:18:04.955036 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 380/801] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:04 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:04.956205 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e1d9009e-5672-49ba-a765-c2c4cbd7abd3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:04.957330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e1d9009e-5672-49ba-a765-c2c4cbd7abd3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1406 microversion: 2.20 time: 0.164102 Jun 16 21:18:04.958052 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 422/802] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:18:04 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:18:05.971534 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-cc028988-36f1-4c17-92bb-0e86169514f3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:05.972153 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-cc028988-36f1-4c17-92bb-0e86169514f3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:05.974864 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e3a38fec-19f6-4f14-ae48-0d0783b16a76 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:05.975478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e3a38fec-19f6-4f14-ae48-0d0783b16a76 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:05.978979 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cc028988-36f1-4c17-92bb-0e86169514f3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:05.979540 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cc028988-36f1-4c17-92bb-0e86169514f3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:05.980738 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cc028988-36f1-4c17-92bb-0e86169514f3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:05.981175 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cc028988-36f1-4c17-92bb-0e86169514f3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:05.981916 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e3a38fec-19f6-4f14-ae48-0d0783b16a76 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:05.982358 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e3a38fec-19f6-4f14-ae48-0d0783b16a76 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:05.983131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e3a38fec-19f6-4f14-ae48-0d0783b16a76 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:05.983547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e3a38fec-19f6-4f14-ae48-0d0783b16a76 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:05.983834 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:06.121013 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-cc028988-36f1-4c17-92bb-0e86169514f3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:06.129541 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-cc028988-36f1-4c17-92bb-0e86169514f3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1573 microversion: 2.1 time: 0.162062 Jun 16 21:18:06.130141 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 381/803] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:05 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:06.394286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e3a38fec-19f6-4f14-ae48-0d0783b16a76 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:06.402364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e3a38fec-19f6-4f14-ae48-0d0783b16a76 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:06.403991 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e3a38fec-19f6-4f14-ae48-0d0783b16a76 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:06.405166 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e3a38fec-19f6-4f14-ae48-0d0783b16a76 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1406 microversion: 2.20 time: 0.434332 Jun 16 21:18:06.405717 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 423/804] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:18:05 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1406 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:18:07.080079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d4c3575d-b266-450d-b540-b20ca96992f3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27c4460e-f225-4d5b-bb8d-c91ea0b2f456"}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:07.081460 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d4c3575d-b266-450d-b540-b20ca96992f3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:07.087986 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d4c3575d-b266-450d-b540-b20ca96992f3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:07.088471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d4c3575d-b266-450d-b540-b20ca96992f3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:07.089238 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d4c3575d-b266-450d-b540-b20ca96992f3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:07.089734 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d4c3575d-b266-450d-b540-b20ca96992f3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:07.147509 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-283616bd-c897-499f-a1ea-b6b91d2f3790 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:07.148415 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-283616bd-c897-499f-a1ea-b6b91d2f3790 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:07.155557 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-283616bd-c897-499f-a1ea-b6b91d2f3790 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:07.156108 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-283616bd-c897-499f-a1ea-b6b91d2f3790 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:07.157222 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-283616bd-c897-499f-a1ea-b6b91d2f3790 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:07.158405 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-283616bd-c897-499f-a1ea-b6b91d2f3790 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:07.335269 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-283616bd-c897-499f-a1ea-b6b91d2f3790 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:07.344220 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-283616bd-c897-499f-a1ea-b6b91d2f3790 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1573 microversion: 2.1 time: 0.200671 Jun 16 21:18:07.345790 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 424/805] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:07 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1573 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:07.350693 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-30f0c0da-7176-4fe2-8766-57589615e7b3 req-747965cf-e1a0-4f8f-9087-3d206b74a9ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1b5610-fa96-44cf-b05b-41a354370d1c", "name": "network-vif-plugged", "status": "completed", "tag": "ce808840-2e04-4b62-89bc-caeba961a739"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:07.361124 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-30f0c0da-7176-4fe2-8766-57589615e7b3 req-747965cf-e1a0-4f8f-9087-3d206b74a9ae service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:07.361912 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-30f0c0da-7176-4fe2-8766-57589615e7b3 req-747965cf-e1a0-4f8f-9087-3d206b74a9ae service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:07.378106 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-30f0c0da-7176-4fe2-8766-57589615e7b3 req-747965cf-e1a0-4f8f-9087-3d206b74a9ae service nova] Creating event network-vif-plugged:ce808840-2e04-4b62-89bc-caeba961a739 for instance 6a1b5610-fa96-44cf-b05b-41a354370d1c on hv-cinder-81914 Jun 16 21:18:07.384352 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-30f0c0da-7176-4fe2-8766-57589615e7b3 req-747965cf-e1a0-4f8f-9087-3d206b74a9ae service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036778 Jun 16 21:18:07.385171 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 425/806] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:07.425639 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-51cb233f-6d5a-418b-8086-6b460af31986 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:07.426343 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-51cb233f-6d5a-418b-8086-6b460af31986 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:07.433834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-51cb233f-6d5a-418b-8086-6b460af31986 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:07.434366 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-51cb233f-6d5a-418b-8086-6b460af31986 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:07.436064 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-51cb233f-6d5a-418b-8086-6b460af31986 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:07.436537 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-51cb233f-6d5a-418b-8086-6b460af31986 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:07.595581 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d4c3575d-b266-450d-b540-b20ca96992f3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "POST /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515641 Jun 16 21:18:07.595581 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 382/807] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 16 21:18:07 2022] POST /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/os-volume_attachments => generated 194 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:07.611508 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-51cb233f-6d5a-418b-8086-6b460af31986 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:07.623161 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-51cb233f-6d5a-418b-8086-6b460af31986 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:07.627918 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-51cb233f-6d5a-418b-8086-6b460af31986 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:07.629123 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-51cb233f-6d5a-418b-8086-6b460af31986 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1406 microversion: 2.20 time: 0.209099 Jun 16 21:18:07.629700 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 426/808] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:18:07 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:18:08.363160 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-615b81d7-de4a-4f94-87db-d65fe0e8ed9f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:08.363876 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-615b81d7-de4a-4f94-87db-d65fe0e8ed9f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:08.371182 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-615b81d7-de4a-4f94-87db-d65fe0e8ed9f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:08.371625 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-615b81d7-de4a-4f94-87db-d65fe0e8ed9f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:08.372449 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-615b81d7-de4a-4f94-87db-d65fe0e8ed9f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:08.372885 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-615b81d7-de4a-4f94-87db-d65fe0e8ed9f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:08.506366 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-615b81d7-de4a-4f94-87db-d65fe0e8ed9f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:08.513815 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-615b81d7-de4a-4f94-87db-d65fe0e8ed9f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1573 microversion: 2.1 time: 0.155449 Jun 16 21:18:08.514361 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 383/809] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:08 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:08.646956 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8a778f34-cddf-4de0-bc4b-9aba65e49b1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:08.647457 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8a778f34-cddf-4de0-bc4b-9aba65e49b1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:08.653885 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8a778f34-cddf-4de0-bc4b-9aba65e49b1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:08.654324 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8a778f34-cddf-4de0-bc4b-9aba65e49b1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:08.655101 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8a778f34-cddf-4de0-bc4b-9aba65e49b1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:08.655525 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8a778f34-cddf-4de0-bc4b-9aba65e49b1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:08.792375 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8a778f34-cddf-4de0-bc4b-9aba65e49b1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:08.802535 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8a778f34-cddf-4de0-bc4b-9aba65e49b1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:08.805020 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8a778f34-cddf-4de0-bc4b-9aba65e49b1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:08.806171 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8a778f34-cddf-4de0-bc4b-9aba65e49b1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1406 microversion: 2.20 time: 0.163207 Jun 16 21:18:08.806744 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 427/810] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:18:08 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:18:09.401492 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-c63f58b9-8ac5-4075-9736-9eefb01e2f35 req-c205922e-e156-4a4b-8daf-36b8a87c1f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329313fc-d559-41c6-9dad-471e57c9751e", "name": "network-vif-plugged", "status": "completed", "tag": "dbb3b245-c7c5-45cc-8bc9-e46efbfd90bb"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:09.405756 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=6 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:09.412784 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-c63f58b9-8ac5-4075-9736-9eefb01e2f35 req-c205922e-e156-4a4b-8daf-36b8a87c1f3a service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:09.413228 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-c63f58b9-8ac5-4075-9736-9eefb01e2f35 req-c205922e-e156-4a4b-8daf-36b8a87c1f3a service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:09.424639 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-c63f58b9-8ac5-4075-9736-9eefb01e2f35 req-c205922e-e156-4a4b-8daf-36b8a87c1f3a service nova] Creating event network-vif-plugged:dbb3b245-c7c5-45cc-8bc9-e46efbfd90bb for instance 329313fc-d559-41c6-9dad-471e57c9751e on hv-cinder-81914 Jun 16 21:18:09.429305 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-c63f58b9-8ac5-4075-9736-9eefb01e2f35 req-c205922e-e156-4a4b-8daf-36b8a87c1f3a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032131 Jun 16 21:18:09.429867 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 384/811] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:09.530895 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9d81c5d9-3e9b-4728-8973-ef7345462c17 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:09.531536 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-9d81c5d9-3e9b-4728-8973-ef7345462c17 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:09.534206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:09.534850 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=6 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:09.541086 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9d81c5d9-3e9b-4728-8973-ef7345462c17 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:09.541715 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9d81c5d9-3e9b-4728-8973-ef7345462c17 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:09.542129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9d81c5d9-3e9b-4728-8973-ef7345462c17 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:09.542572 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9d81c5d9-3e9b-4728-8973-ef7345462c17 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:09.675900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9d81c5d9-3e9b-4728-8973-ef7345462c17 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:09.683354 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9d81c5d9-3e9b-4728-8973-ef7345462c17 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1573 microversion: 2.1 time: 0.156300 Jun 16 21:18:09.683925 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 428/812] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:09 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:09.883178 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1cd07ffd-df3a-4fa9-89e6-586f0f6c3502 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:09.883957 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1cd07ffd-df3a-4fa9-89e6-586f0f6c3502 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:09.890273 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1cd07ffd-df3a-4fa9-89e6-586f0f6c3502 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:09.890717 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1cd07ffd-df3a-4fa9-89e6-586f0f6c3502 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:09.892031 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1cd07ffd-df3a-4fa9-89e6-586f0f6c3502 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:09.893074 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1cd07ffd-df3a-4fa9-89e6-586f0f6c3502 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:10.018798 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1cd07ffd-df3a-4fa9-89e6-586f0f6c3502 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:10.027380 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1cd07ffd-df3a-4fa9-89e6-586f0f6c3502 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:10.028914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1cd07ffd-df3a-4fa9-89e6-586f0f6c3502 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:10.030076 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1cd07ffd-df3a-4fa9-89e6-586f0f6c3502 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1597 microversion: 2.20 time: 0.209301 Jun 16 21:18:10.030626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 385/813] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:18:09 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1597 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:18:10.046936 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b8593d5f-32a7-42c4-8b3c-8f9a4540db72 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:10.047422 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b8593d5f-32a7-42c4-8b3c-8f9a4540db72 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:10.054038 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b8593d5f-32a7-42c4-8b3c-8f9a4540db72 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:10.054477 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b8593d5f-32a7-42c4-8b3c-8f9a4540db72 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:10.055223 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b8593d5f-32a7-42c4-8b3c-8f9a4540db72 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:10.055648 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b8593d5f-32a7-42c4-8b3c-8f9a4540db72 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:10.134606 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b8593d5f-32a7-42c4-8b3c-8f9a4540db72 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091447 Jun 16 21:18:10.135192 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 429/814] 10.222.0.43 () {60 vars in 1315 bytes} [Thu Jun 16 21:18:10 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:18:10.700255 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9f0e9398-b72e-42e7-aff1-35f54f11f12d tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:10.700862 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-9f0e9398-b72e-42e7-aff1-35f54f11f12d tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:10.706806 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9f0e9398-b72e-42e7-aff1-35f54f11f12d tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:10.707251 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9f0e9398-b72e-42e7-aff1-35f54f11f12d tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:10.708014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9f0e9398-b72e-42e7-aff1-35f54f11f12d tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:10.708465 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9f0e9398-b72e-42e7-aff1-35f54f11f12d tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:10.851763 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9f0e9398-b72e-42e7-aff1-35f54f11f12d tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:10.859409 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-9f0e9398-b72e-42e7-aff1-35f54f11f12d tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1573 microversion: 2.1 time: 0.162952 Jun 16 21:18:10.859966 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 386/815] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:10 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:11.059024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-ea3d1acd-d71d-4a86-9270-acf0c0693185 req-b37d2faf-6522-4beb-a364-89e8f236fd3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a1b5610-fa96-44cf-b05b-41a354370d1c", "tag": "ce808840-2e04-4b62-89bc-caeba961a739"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:11.067597 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-ea3d1acd-d71d-4a86-9270-acf0c0693185 req-b37d2faf-6522-4beb-a364-89e8f236fd3f service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:11.068039 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-ea3d1acd-d71d-4a86-9270-acf0c0693185 req-b37d2faf-6522-4beb-a364-89e8f236fd3f service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:11.078938 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-ea3d1acd-d71d-4a86-9270-acf0c0693185 req-b37d2faf-6522-4beb-a364-89e8f236fd3f service nova] Creating event network-changed:ce808840-2e04-4b62-89bc-caeba961a739 for instance 6a1b5610-fa96-44cf-b05b-41a354370d1c on hv-cinder-81914 Jun 16 21:18:11.084594 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-ea3d1acd-d71d-4a86-9270-acf0c0693185 req-b37d2faf-6522-4beb-a364-89e8f236fd3f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029597 Jun 16 21:18:11.085212 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 430/816] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:11.876856 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a6204109-6b79-47f0-92f8-f067a3a3a88a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:11.877538 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a6204109-6b79-47f0-92f8-f067a3a3a88a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:11.884217 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a6204109-6b79-47f0-92f8-f067a3a3a88a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:11.885079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a6204109-6b79-47f0-92f8-f067a3a3a88a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:11.886030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a6204109-6b79-47f0-92f8-f067a3a3a88a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:11.886658 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a6204109-6b79-47f0-92f8-f067a3a3a88a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:12.024775 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a6204109-6b79-47f0-92f8-f067a3a3a88a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:12.033497 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a6204109-6b79-47f0-92f8-f067a3a3a88a tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1560 microversion: 2.1 time: 0.161180 Jun 16 21:18:12.034396 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 387/817] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:11 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:14.412602 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c6185963-fa47-4d3c-a1aa-d3d49d980703 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:14.413173 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c6185963-fa47-4d3c-a1aa-d3d49d980703 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:14.419288 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c6185963-fa47-4d3c-a1aa-d3d49d980703 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:14.419725 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c6185963-fa47-4d3c-a1aa-d3d49d980703 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:14.420493 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c6185963-fa47-4d3c-a1aa-d3d49d980703 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:14.420917 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c6185963-fa47-4d3c-a1aa-d3d49d980703 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:14.443016 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c6185963-fa47-4d3c-a1aa-d3d49d980703 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba/ips" status: 200 len: 150 microversion: 2.1 time: 0.139209 Jun 16 21:18:14.443561 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 431/818] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 16 21:18:14 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba/ips => generated 150 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:15.118974 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-739aeacc-c08f-440b-8141-2c46de897dc2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:15.120069 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-739aeacc-c08f-440b-8141-2c46de897dc2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:15.126745 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-739aeacc-c08f-440b-8141-2c46de897dc2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:15.127214 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-739aeacc-c08f-440b-8141-2c46de897dc2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:15.127987 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-739aeacc-c08f-440b-8141-2c46de897dc2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:15.128455 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-739aeacc-c08f-440b-8141-2c46de897dc2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:15.152558 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.objects.instance [None req-739aeacc-c08f-440b-8141-2c46de897dc2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lazy-loading 'flavor' on Instance uuid 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 {{(pid=117738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:18:15.273884 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-739aeacc-c08f-440b-8141-2c46de897dc2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "POST /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/action" status: 200 len: 32 microversion: 2.1 time: 0.159046 Jun 16 21:18:15.274414 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 388/819] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 16 21:18:15 2022] POST /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 21:18:15.285296 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-3019a417-1acc-4f5a-8f38-3612381cfa3a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:15.285894 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-3019a417-1acc-4f5a-8f38-3612381cfa3a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:15.292615 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3019a417-1acc-4f5a-8f38-3612381cfa3a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:15.293119 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3019a417-1acc-4f5a-8f38-3612381cfa3a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:15.294055 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3019a417-1acc-4f5a-8f38-3612381cfa3a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:15.294530 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3019a417-1acc-4f5a-8f38-3612381cfa3a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:15.516101 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3019a417-1acc-4f5a-8f38-3612381cfa3a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:15.525001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-3019a417-1acc-4f5a-8f38-3612381cfa3a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.244617 Jun 16 21:18:15.525503 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 432/820] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:15 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:15.776556 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-549b26e9-6e61-47bd-bb09-cd15405ec977 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32c2575f-c34f-43a2-bd3d-81f82860094c"}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:15.777648 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-549b26e9-6e61-47bd-bb09-cd15405ec977 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:15.783802 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-549b26e9-6e61-47bd-bb09-cd15405ec977 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:15.784287 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-549b26e9-6e61-47bd-bb09-cd15405ec977 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:15.785062 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-549b26e9-6e61-47bd-bb09-cd15405ec977 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:15.785494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-549b26e9-6e61-47bd-bb09-cd15405ec977 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:16.022764 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-549b26e9-6e61-47bd-bb09-cd15405ec977 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "POST /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250521 Jun 16 21:18:16.023348 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 389/821] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 16 21:18:15 2022] POST /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:16.543242 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8d927c65-47b9-45b8-9219-4deb97378a5b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:16.543849 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8d927c65-47b9-45b8-9219-4deb97378a5b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:16.551019 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8d927c65-47b9-45b8-9219-4deb97378a5b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:16.551456 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8d927c65-47b9-45b8-9219-4deb97378a5b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:16.552319 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8d927c65-47b9-45b8-9219-4deb97378a5b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:16.552746 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8d927c65-47b9-45b8-9219-4deb97378a5b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:16.685539 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8d927c65-47b9-45b8-9219-4deb97378a5b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:16.693947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8d927c65-47b9-45b8-9219-4deb97378a5b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.154532 Jun 16 21:18:16.694535 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 433/822] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:16 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:17.712300 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-bbb1a6bf-be26-4dbf-8769-8f1f80686ea6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:17.713000 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-bbb1a6bf-be26-4dbf-8769-8f1f80686ea6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:17.719193 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bbb1a6bf-be26-4dbf-8769-8f1f80686ea6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:17.719639 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bbb1a6bf-be26-4dbf-8769-8f1f80686ea6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:17.721261 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bbb1a6bf-be26-4dbf-8769-8f1f80686ea6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:17.721697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bbb1a6bf-be26-4dbf-8769-8f1f80686ea6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:17.855058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-bbb1a6bf-be26-4dbf-8769-8f1f80686ea6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:17.863130 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-bbb1a6bf-be26-4dbf-8769-8f1f80686ea6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.155560 Jun 16 21:18:17.863700 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 390/823] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:17 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:18.880883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-99f647ac-adce-4e33-a22e-2068e3a88198 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:18.881463 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-99f647ac-adce-4e33-a22e-2068e3a88198 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:18.887904 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-99f647ac-adce-4e33-a22e-2068e3a88198 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:18.888394 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-99f647ac-adce-4e33-a22e-2068e3a88198 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:18.889150 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-99f647ac-adce-4e33-a22e-2068e3a88198 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:18.889578 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-99f647ac-adce-4e33-a22e-2068e3a88198 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:19.020394 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-99f647ac-adce-4e33-a22e-2068e3a88198 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:19.028314 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-99f647ac-adce-4e33-a22e-2068e3a88198 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.151839 Jun 16 21:18:19.028880 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 434/824] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:18 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:20.045285 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b186aada-0523-4b7e-9dc1-fb7ee8a1b7bf tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:20.045891 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b186aada-0523-4b7e-9dc1-fb7ee8a1b7bf tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:20.053085 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b186aada-0523-4b7e-9dc1-fb7ee8a1b7bf tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:20.053530 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b186aada-0523-4b7e-9dc1-fb7ee8a1b7bf tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:20.054282 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b186aada-0523-4b7e-9dc1-fb7ee8a1b7bf tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:20.054713 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b186aada-0523-4b7e-9dc1-fb7ee8a1b7bf tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:20.183203 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b186aada-0523-4b7e-9dc1-fb7ee8a1b7bf tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:20.191597 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b186aada-0523-4b7e-9dc1-fb7ee8a1b7bf tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.150149 Jun 16 21:18:20.192158 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 391/825] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:20 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:21.209156 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-88897432-aa79-4ef6-82f5-4edb7401817f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:21.209767 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-88897432-aa79-4ef6-82f5-4edb7401817f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:21.216323 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-88897432-aa79-4ef6-82f5-4edb7401817f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:21.216766 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-88897432-aa79-4ef6-82f5-4edb7401817f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:21.217525 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-88897432-aa79-4ef6-82f5-4edb7401817f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:21.217954 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-88897432-aa79-4ef6-82f5-4edb7401817f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:21.346720 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-88897432-aa79-4ef6-82f5-4edb7401817f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:21.354724 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-88897432-aa79-4ef6-82f5-4edb7401817f tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.149478 Jun 16 21:18:21.355285 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 435/826] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:21 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:22.370904 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-04b8bbfa-4c10-49c1-b18e-2e7e926f201a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:22.371514 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-04b8bbfa-4c10-49c1-b18e-2e7e926f201a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:22.377725 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04b8bbfa-4c10-49c1-b18e-2e7e926f201a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:22.378174 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04b8bbfa-4c10-49c1-b18e-2e7e926f201a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:22.378943 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04b8bbfa-4c10-49c1-b18e-2e7e926f201a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:22.379380 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04b8bbfa-4c10-49c1-b18e-2e7e926f201a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:22.508296 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-04b8bbfa-4c10-49c1-b18e-2e7e926f201a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:22.516138 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-04b8bbfa-4c10-49c1-b18e-2e7e926f201a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.149365 Jun 16 21:18:22.516716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 392/827] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:22 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:23.515044 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f80c7d1f-8326-4541-858e-2b7c17ac9f03 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32c2575f-c34f-43a2-bd3d-81f82860094c"}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:23.516095 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f80c7d1f-8326-4541-858e-2b7c17ac9f03 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:23.522663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f80c7d1f-8326-4541-858e-2b7c17ac9f03 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:23.523474 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f80c7d1f-8326-4541-858e-2b7c17ac9f03 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:23.523866 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f80c7d1f-8326-4541-858e-2b7c17ac9f03 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:23.524329 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f80c7d1f-8326-4541-858e-2b7c17ac9f03 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:23.534280 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0cea0ff1-3017-486f-8e9d-8ba237bec85b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:23.535448 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0cea0ff1-3017-486f-8e9d-8ba237bec85b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:23.541830 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0cea0ff1-3017-486f-8e9d-8ba237bec85b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:23.542258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0cea0ff1-3017-486f-8e9d-8ba237bec85b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:23.543019 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0cea0ff1-3017-486f-8e9d-8ba237bec85b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:23.543450 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0cea0ff1-3017-486f-8e9d-8ba237bec85b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:23.604915 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-f80c7d1f-8326-4541-858e-2b7c17ac9f03 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] HTTP exception thrown: Invalid volume: volume 32c2575f-c34f-43a2-bd3d-81f82860094c is already attached to instances: 5ea6b530-d41f-4b72-af93-e2cdb36addba Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f80c7d1f-8326-4541-858e-2b7c17ac9f03 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Request method failure captured: Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: POST /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba/os-volume_attachments HTTP/1.1 Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 74 Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5znrg1BlivpFkHnanzWccs2prlszc98SqsEUcUzeeIaKSEmJ9fzENTsjOpe5Qk_NQzgYSx59EKzIYY5fjkk4rwfyQQuYnSRsoplrpGBs8lpSHsUHoyoefKGRLOyWSvHcegVce7Q5IbVWJWykg-Seg-ZRUqsFo_eKeCcFzUevqUD7uU Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:18:23.606769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:18:23.608148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f22cbeb1402848dbb84a5718dca357e1"}]}] Jun 16 21:18:23.608148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:18:23.608148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:18:23.608148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:18:23.608148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:18:23.608148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:18:23.608148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:18:23.608148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 2cb12a51b62c48ba95be62f167b7314e Jun 16 21:18:23.608148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:18:23.608148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Jun 16 21:18:23.608148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {"volumeAttachment": {"volumeId": "32c2575f-c34f-43a2-bd3d-81f82860094c"}} Jun 16 21:18:23.608148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Invalid volume: volume 32c2575f-c34f-43a2-bd3d-81f82860094c is already attached to instances: 5ea6b530-d41f-4b72-af93-e2cdb36addba Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'server_id': '5ea6b530-d41f-4b72-af93-e2cdb36addba', 'body': {'volumeAttachment': {'volumeId': '32c2575f-c34f-43a2-bd3d-81f82860094c'}}} Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 32c2575f-c34f-43a2-bd3d-81f82860094c is already attached to instances: 5ea6b530-d41f-4b72-af93-e2cdb36addba Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:18:23.608913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 32c2575f-c34f-43a2-bd3d-81f82860094c is already attached to instances: 5ea6b530-d41f-4b72-af93-e2cdb36addba Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:23.610054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:18:23.611218 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:18:23.611218 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:18:23.611218 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:18:23.611218 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 32c2575f-c34f-43a2-bd3d-81f82860094c is already attached to instances: 5ea6b530-d41f-4b72-af93-e2cdb36addba Jun 16 21:18:23.611218 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:18:23.611218 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f80c7d1f-8326-4541-858e-2b7c17ac9f03 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Returning 400 to user: Invalid volume: volume 32c2575f-c34f-43a2-bd3d-81f82860094c is already attached to instances: 5ea6b530-d41f-4b72-af93-e2cdb36addba {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:18:23.611218 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f80c7d1f-8326-4541-858e-2b7c17ac9f03 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "POST /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097200 Jun 16 21:18:23.611218 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 436/828] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 16 21:18:23 2022] POST /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 21:18:23.671929 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-29efa242-7071-46ab-9f1c-1c3f3d133cf0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:23.672441 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-29efa242-7071-46ab-9f1c-1c3f3d133cf0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:23.680477 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0cea0ff1-3017-486f-8e9d-8ba237bec85b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:23.682710 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:23.684384 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-29efa242-7071-46ab-9f1c-1c3f3d133cf0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:23.684878 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-29efa242-7071-46ab-9f1c-1c3f3d133cf0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:23.685654 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-29efa242-7071-46ab-9f1c-1c3f3d133cf0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:23.686086 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-29efa242-7071-46ab-9f1c-1c3f3d133cf0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:23.689559 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0cea0ff1-3017-486f-8e9d-8ba237bec85b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.159628 Jun 16 21:18:23.690651 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 393/829] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:23 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:23.765839 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.objects.instance [None req-29efa242-7071-46ab-9f1c-1c3f3d133cf0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lazy-loading 'services' on Instance uuid 5ea6b530-d41f-4b72-af93-e2cdb36addba {{(pid=117737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:18:23.837482 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-29efa242-7071-46ab-9f1c-1c3f3d133cf0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba/os-volume_attachments/32c2575f-c34f-43a2-bd3d-81f82860094c" status: 202 len: 0 microversion: 2.1 time: 0.169223 Jun 16 21:18:23.838129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 437/830] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 16 21:18:23 2022] DELETE /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba/os-volume_attachments/32c2575f-c34f-43a2-bd3d-81f82860094c => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 21:18:23.847054 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c2097ed1-4915-4d4b-b11d-70b46d19ca49 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:23.848124 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c2097ed1-4915-4d4b-b11d-70b46d19ca49 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:23.856535 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c2097ed1-4915-4d4b-b11d-70b46d19ca49 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:23.857129 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c2097ed1-4915-4d4b-b11d-70b46d19ca49 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:23.858166 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c2097ed1-4915-4d4b-b11d-70b46d19ca49 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:23.858909 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c2097ed1-4915-4d4b-b11d-70b46d19ca49 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:23.891447 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c2097ed1-4915-4d4b-b11d-70b46d19ca49 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048991 Jun 16 21:18:23.891984 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 394/831] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:18:23 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:24.708723 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-be088446-c9a0-4425-b878-f244d615235b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:24.709549 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-be088446-c9a0-4425-b878-f244d615235b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:24.715627 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-be088446-c9a0-4425-b878-f244d615235b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:24.716837 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-be088446-c9a0-4425-b878-f244d615235b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:24.717796 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-be088446-c9a0-4425-b878-f244d615235b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:24.718241 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-be088446-c9a0-4425-b878-f244d615235b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:24.862967 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-be088446-c9a0-4425-b878-f244d615235b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:24.871284 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-be088446-c9a0-4425-b878-f244d615235b tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.168205 Jun 16 21:18:24.871851 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 438/832] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:24 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:24.902918 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-71e8caa8-0c40-4428-b503-dce02bcf9583 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:24.903826 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-71e8caa8-0c40-4428-b503-dce02bcf9583 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:24.911273 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-71e8caa8-0c40-4428-b503-dce02bcf9583 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:24.911710 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-71e8caa8-0c40-4428-b503-dce02bcf9583 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:24.912523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-71e8caa8-0c40-4428-b503-dce02bcf9583 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:24.912950 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-71e8caa8-0c40-4428-b503-dce02bcf9583 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:24.940513 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-71e8caa8-0c40-4428-b503-dce02bcf9583 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041072 Jun 16 21:18:24.941055 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 395/833] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:18:24 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 21:18:24.998603 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a81c8830-2e5e-4d2b-a3f6-d1219b221f06 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:24.999097 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a81c8830-2e5e-4d2b-a3f6-d1219b221f06 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:25.006123 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a81c8830-2e5e-4d2b-a3f6-d1219b221f06 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:25.006564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a81c8830-2e5e-4d2b-a3f6-d1219b221f06 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:25.007318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a81c8830-2e5e-4d2b-a3f6-d1219b221f06 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:25.007761 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a81c8830-2e5e-4d2b-a3f6-d1219b221f06 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:25.032594 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a81c8830-2e5e-4d2b-a3f6-d1219b221f06 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Going to try to terminate instance {{(pid=117737) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:18:25.035767 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:25.110341 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a81c8830-2e5e-4d2b-a3f6-d1219b221f06 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 204 len: 0 microversion: 2.1 time: 0.115258 Jun 16 21:18:25.110925 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 439/834] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:18:24 2022] DELETE /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:18:25.121467 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-53de2f43-635c-4316-8b6d-b3bc4f3def4e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:25.122081 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-53de2f43-635c-4316-8b6d-b3bc4f3def4e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:25.128783 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-53de2f43-635c-4316-8b6d-b3bc4f3def4e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:25.129232 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-53de2f43-635c-4316-8b6d-b3bc4f3def4e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:25.129991 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-53de2f43-635c-4316-8b6d-b3bc4f3def4e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:25.130421 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-53de2f43-635c-4316-8b6d-b3bc4f3def4e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:25.258064 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-53de2f43-635c-4316-8b6d-b3bc4f3def4e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:25.265602 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-53de2f43-635c-4316-8b6d-b3bc4f3def4e tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 200 len: 1680 microversion: 2.1 time: 0.149554 Jun 16 21:18:25.266154 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 396/835] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:25 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:25.889046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-67e42d48-7e5d-4334-a05b-977b351c0e37 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:25.889672 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-67e42d48-7e5d-4334-a05b-977b351c0e37 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:25.896801 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-67e42d48-7e5d-4334-a05b-977b351c0e37 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:25.897243 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-67e42d48-7e5d-4334-a05b-977b351c0e37 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:25.898004 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-67e42d48-7e5d-4334-a05b-977b351c0e37 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:25.898435 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-67e42d48-7e5d-4334-a05b-977b351c0e37 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:26.033122 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-67e42d48-7e5d-4334-a05b-977b351c0e37 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:26.041155 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-67e42d48-7e5d-4334-a05b-977b351c0e37 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.156467 Jun 16 21:18:26.041714 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 440/836] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:25 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:26.282867 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5485239a-acb2-46ef-9792-a81494555b9d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:26.283392 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5485239a-acb2-46ef-9792-a81494555b9d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:26.289894 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5485239a-acb2-46ef-9792-a81494555b9d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:26.290338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5485239a-acb2-46ef-9792-a81494555b9d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:26.291092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5485239a-acb2-46ef-9792-a81494555b9d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:26.291525 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5485239a-acb2-46ef-9792-a81494555b9d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:26.421565 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5485239a-acb2-46ef-9792-a81494555b9d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:26.429141 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5485239a-acb2-46ef-9792-a81494555b9d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 200 len: 1680 microversion: 2.1 time: 0.150185 Jun 16 21:18:26.429698 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 397/837] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:26 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:27.058595 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-eb8b1e23-79d8-4e52-a2f8-5be627901193 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:27.059207 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-eb8b1e23-79d8-4e52-a2f8-5be627901193 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:27.066544 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-eb8b1e23-79d8-4e52-a2f8-5be627901193 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:27.066892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-eb8b1e23-79d8-4e52-a2f8-5be627901193 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:27.067651 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-eb8b1e23-79d8-4e52-a2f8-5be627901193 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:27.068104 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-eb8b1e23-79d8-4e52-a2f8-5be627901193 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:27.446618 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1948a8b3-71d8-4786-8b92-b749bab1fa26 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:27.447310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1948a8b3-71d8-4786-8b92-b749bab1fa26 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:27.449405 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-eb8b1e23-79d8-4e52-a2f8-5be627901193 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:27.449554 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:27.455131 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1948a8b3-71d8-4786-8b92-b749bab1fa26 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:27.455572 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1948a8b3-71d8-4786-8b92-b749bab1fa26 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:27.457265 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1948a8b3-71d8-4786-8b92-b749bab1fa26 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:27.457700 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1948a8b3-71d8-4786-8b92-b749bab1fa26 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:27.458573 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-eb8b1e23-79d8-4e52-a2f8-5be627901193 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.403698 Jun 16 21:18:27.459407 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 441/838] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:27 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:27.592317 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1948a8b3-71d8-4786-8b92-b749bab1fa26 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:27.601381 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1948a8b3-71d8-4786-8b92-b749bab1fa26 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 200 len: 1680 microversion: 2.1 time: 0.158637 Jun 16 21:18:27.601942 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 398/839] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:27 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:28.233368 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-0bfda226-bed5-4c6e-84be-619be59f3f71 req-3aad822f-c1aa-4a91-ad24-4ebf5651ed98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea6b530-d41f-4b72-af93-e2cdb36addba", "name": "network-vif-deleted", "tag": "fb676485-af3b-4d79-a796-74cac7d6e1ee"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:28.244260 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-0bfda226-bed5-4c6e-84be-619be59f3f71 req-3aad822f-c1aa-4a91-ad24-4ebf5651ed98 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:28.244705 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-0bfda226-bed5-4c6e-84be-619be59f3f71 req-3aad822f-c1aa-4a91-ad24-4ebf5651ed98 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:28.257744 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-0bfda226-bed5-4c6e-84be-619be59f3f71 req-3aad822f-c1aa-4a91-ad24-4ebf5651ed98 service nova] Creating event network-vif-deleted:fb676485-af3b-4d79-a796-74cac7d6e1ee for instance 5ea6b530-d41f-4b72-af93-e2cdb36addba on hv-cinder-81914 Jun 16 21:18:28.263382 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-0bfda226-bed5-4c6e-84be-619be59f3f71 req-3aad822f-c1aa-4a91-ad24-4ebf5651ed98 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033983 Jun 16 21:18:28.263986 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 442/840] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:28.477011 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8b137ed2-25d5-4d3c-9445-43f12d6d03f0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:28.477851 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8b137ed2-25d5-4d3c-9445-43f12d6d03f0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:28.484546 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8b137ed2-25d5-4d3c-9445-43f12d6d03f0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:28.484988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8b137ed2-25d5-4d3c-9445-43f12d6d03f0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:28.485760 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8b137ed2-25d5-4d3c-9445-43f12d6d03f0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:28.486193 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8b137ed2-25d5-4d3c-9445-43f12d6d03f0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:28.620588 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a22de498-9a67-4c29-9b9e-ffd0d351e4f0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:28.623514 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a22de498-9a67-4c29-9b9e-ffd0d351e4f0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:28.631658 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a22de498-9a67-4c29-9b9e-ffd0d351e4f0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:28.632115 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a22de498-9a67-4c29-9b9e-ffd0d351e4f0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:28.632780 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8b137ed2-25d5-4d3c-9445-43f12d6d03f0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:28.633211 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a22de498-9a67-4c29-9b9e-ffd0d351e4f0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:28.633594 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a22de498-9a67-4c29-9b9e-ffd0d351e4f0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:28.642820 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8b137ed2-25d5-4d3c-9445-43f12d6d03f0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.169303 Jun 16 21:18:28.648216 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 399/841] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:28 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:28.669351 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a22de498-9a67-4c29-9b9e-ffd0d351e4f0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:28.670152 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a22de498-9a67-4c29-9b9e-ffd0d351e4f0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:28.670976 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.objects.instance [None req-a22de498-9a67-4c29-9b9e-ffd0d351e4f0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lazy-loading 'fault' on Instance uuid 5ea6b530-d41f-4b72-af93-e2cdb36addba {{(pid=117737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:18:28.723567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a22de498-9a67-4c29-9b9e-ffd0d351e4f0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:28.731762 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a22de498-9a67-4c29-9b9e-ffd0d351e4f0 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 200 len: 1330 microversion: 2.1 time: 0.116763 Jun 16 21:18:28.732443 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 443/842] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:28 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:29.660973 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-db2eed21-a2c5-4c0f-b2d3-b6a53c8aa260 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:29.661615 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-db2eed21-a2c5-4c0f-b2d3-b6a53c8aa260 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:29.668198 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-db2eed21-a2c5-4c0f-b2d3-b6a53c8aa260 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:29.668664 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-db2eed21-a2c5-4c0f-b2d3-b6a53c8aa260 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:29.669434 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-db2eed21-a2c5-4c0f-b2d3-b6a53c8aa260 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:29.669871 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-db2eed21-a2c5-4c0f-b2d3-b6a53c8aa260 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:29.749714 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-56d12a0a-d76e-4dea-b36f-0248dac60523 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:29.750728 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-56d12a0a-d76e-4dea-b36f-0248dac60523 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:29.757163 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-56d12a0a-d76e-4dea-b36f-0248dac60523 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:29.757734 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-56d12a0a-d76e-4dea-b36f-0248dac60523 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:29.758643 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-56d12a0a-d76e-4dea-b36f-0248dac60523 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:29.759085 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-56d12a0a-d76e-4dea-b36f-0248dac60523 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:29.773740 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-56d12a0a-d76e-4dea-b36f-0248dac60523 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] HTTP exception thrown: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-56d12a0a-d76e-4dea-b36f-0248dac60523 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Request method failure captured: Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba HTTP/1.1 Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5znrg1BlivpFkHnanzWccs2prlszc98SqsEUcUzeeIaKSEmJ9fzENTsjOpe5Qk_NQzgYSx59EKzIYY5fjkk4rwfyQQuYnSRsoplrpGBs8lpSHsUHoyoefKGRLOyWSvHcegVce7Q5IbVWJWykg-Seg-ZRUqsFo_eKeCcFzUevqUD7uU Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:18:29.775412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:18:29.777001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f22cbeb1402848dbb84a5718dca357e1"}]}] Jun 16 21:18:29.777001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:18:29.777001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:18:29.777001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:18:29.777001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:18:29.777001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:18:29.777001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:18:29.777001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 2cb12a51b62c48ba95be62f167b7314e Jun 16 21:18:29.777001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:18:29.777001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:18:29.777001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. Jun 16 21:18:29.777001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '5ea6b530-d41f-4b72-af93-e2cdb36addba'} Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:18:29.777900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. Jun 16 21:18:29.779401 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:18:29.780800 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-56d12a0a-d76e-4dea-b36f-0248dac60523 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Returning 404 to user: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:18:29.780800 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-56d12a0a-d76e-4dea-b36f-0248dac60523 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 404 len: 111 microversion: 2.1 time: 0.031036 Jun 16 21:18:29.780988 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 444/843] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:29 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:18:29.786331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-aa25e9af-cd65-49d9-bb34-808387da55d8 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '.version_select at 0x7fb3f76ad1f0>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:29.804633 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-aa25e9af-cd65-49d9-bb34-808387da55d8 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-900089757" status: 202 len: 0 microversion: 2.1 time: 0.022574 Jun 16 21:18:29.805240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 445/844] 10.222.0.43 () {58 vars in 1217 bytes} [Thu Jun 16 21:18:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-900089757 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:18:29.807478 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-db2eed21-a2c5-4c0f-b2d3-b6a53c8aa260 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:29.816152 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-db2eed21-a2c5-4c0f-b2d3-b6a53c8aa260 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.159297 Jun 16 21:18:29.816939 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 400/845] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:29 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:30.419066 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4ad4810b-a302-45bd-9d50-844a7a8ad1a5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Action: 'create', calling method: .version_select at 0x7fb3fddf5dc0>, body: {"keypair": {"name": "tempest-keypair-1768816861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfhz/uLqstdyLTLTJlBdrpfwC+JuqW7UgYkjjjc3mG3l/+ZauMEO1sq/eBxPNMigcm5MKojSFE3kt/MfEOCNSbICLsmomwm0qByVbzZuGGKncr09VX3EhEd2SbMfGcyjQ=="}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:30.433808 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-4ad4810b-a302-45bd-9d50-844a7a8ad1a5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Getting quotas for project f22cbeb1402848dbb84a5718dca357e1. Resources: {'key_pairs'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:18:30.437588 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-4ad4810b-a302-45bd-9d50-844a7a8ad1a5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Getting quotas for user 2cb12a51b62c48ba95be62f167b7314e and project f22cbeb1402848dbb84a5718dca357e1. Resources: {'key_pairs'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:18:30.458696 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4ad4810b-a302-45bd-9d50-844a7a8ad1a5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043566 Jun 16 21:18:30.459265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 446/846] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 16 21:18:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:30.834391 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2a9e7a05-4fc1-4541-bb59-e9de0bb56384 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:30.835005 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2a9e7a05-4fc1-4541-bb59-e9de0bb56384 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:30.841698 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2a9e7a05-4fc1-4541-bb59-e9de0bb56384 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:30.842152 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2a9e7a05-4fc1-4541-bb59-e9de0bb56384 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:30.842929 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2a9e7a05-4fc1-4541-bb59-e9de0bb56384 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:30.843367 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2a9e7a05-4fc1-4541-bb59-e9de0bb56384 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:31.056473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2a9e7a05-4fc1-4541-bb59-e9de0bb56384 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:31.064568 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2a9e7a05-4fc1-4541-bb59-e9de0bb56384 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.234794 Jun 16 21:18:31.065276 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 401/847] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:30 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:31.772784 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a43fd22c-9ade-4add-97fb-0b25aa9f234c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-285352896", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4d0a869-8cad-4582-83ab-86c097e04c69"}], "security_groups": [{"name": "tempest-securitygroup--1562598584"}], "key_name": "tempest-keypair-1768816861", "user_data": "}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:31.876068 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.network.neutron [None req-a43fd22c-9ade-4add-97fb-0b25aa9f234c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] validate_networks() for [('c4d0a869-8cad-4582-83ab-86c097e04c69', None, None, None, None, None)] {{(pid=117737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:18:32.081217 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0981d897-a53a-4eb4-9c21-a3cb142d48d3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:32.082067 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0981d897-a53a-4eb4-9c21-a3cb142d48d3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:32.088674 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0981d897-a53a-4eb4-9c21-a3cb142d48d3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:32.089122 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0981d897-a53a-4eb4-9c21-a3cb142d48d3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:32.089890 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0981d897-a53a-4eb4-9c21-a3cb142d48d3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:32.090322 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0981d897-a53a-4eb4-9c21-a3cb142d48d3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:32.223593 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0981d897-a53a-4eb4-9c21-a3cb142d48d3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:32.231499 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0981d897-a53a-4eb4-9c21-a3cb142d48d3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.154732 Jun 16 21:18:32.232065 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 402/848] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:32 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:32.289653 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-a43fd22c-9ade-4add-97fb-0b25aa9f234c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Flavor limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:18:32.290074 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-a43fd22c-9ade-4add-97fb-0b25aa9f234c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Image limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:18:32.290551 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-a43fd22c-9ade-4add-97fb-0b25aa9f234c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Flavor pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:18:32.290959 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-a43fd22c-9ade-4add-97fb-0b25aa9f234c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Image pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:18:32.291372 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-a43fd22c-9ade-4add-97fb-0b25aa9f234c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:18:32.300090 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a43fd22c-9ade-4add-97fb-0b25aa9f234c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:32.300561 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a43fd22c-9ade-4add-97fb-0b25aa9f234c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:32.301360 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a43fd22c-9ade-4add-97fb-0b25aa9f234c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:32.301794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a43fd22c-9ade-4add-97fb-0b25aa9f234c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:32.318523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-a43fd22c-9ade-4add-97fb-0b25aa9f234c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Getting quotas for project f22cbeb1402848dbb84a5718dca357e1. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:18:32.322404 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-a43fd22c-9ade-4add-97fb-0b25aa9f234c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Getting quotas for user 2cb12a51b62c48ba95be62f167b7314e and project f22cbeb1402848dbb84a5718dca357e1. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:18:32.333760 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a43fd22c-9ade-4add-97fb-0b25aa9f234c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Going to run 1 instances... {{(pid=117737) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:18:32.335957 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a43fd22c-9ade-4add-97fb-0b25aa9f234c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:18:32.382832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a43fd22c-9ade-4add-97fb-0b25aa9f234c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.614573 Jun 16 21:18:32.383468 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 447/849] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:18:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:18:32.393812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a12c7528-26c2-4fe4-afa7-6639c18c2c91 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:32.394914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a12c7528-26c2-4fe4-afa7-6639c18c2c91 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:32.448354 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a12c7528-26c2-4fe4-afa7-6639c18c2c91 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:32.455004 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a12c7528-26c2-4fe4-afa7-6639c18c2c91 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1241 microversion: 2.1 time: 0.065525 Jun 16 21:18:32.455676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 403/850] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:32 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:33.249178 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-813334df-1ded-4bfb-acd5-b1a4c14b1ad6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:33.249788 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-813334df-1ded-4bfb-acd5-b1a4c14b1ad6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:33.251739 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:33.257687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-813334df-1ded-4bfb-acd5-b1a4c14b1ad6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:33.258138 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-813334df-1ded-4bfb-acd5-b1a4c14b1ad6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:33.258980 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-813334df-1ded-4bfb-acd5-b1a4c14b1ad6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:33.259447 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-813334df-1ded-4bfb-acd5-b1a4c14b1ad6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:33.409849 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-813334df-1ded-4bfb-acd5-b1a4c14b1ad6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:33.419213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-813334df-1ded-4bfb-acd5-b1a4c14b1ad6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.174321 Jun 16 21:18:33.420060 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 448/851] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:33 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:33.473675 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-975baa44-fc28-4925-9258-f746adf7f31c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:33.474924 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-975baa44-fc28-4925-9258-f746adf7f31c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:33.482790 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-975baa44-fc28-4925-9258-f746adf7f31c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:33.483232 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-975baa44-fc28-4925-9258-f746adf7f31c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:33.483996 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-975baa44-fc28-4925-9258-f746adf7f31c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:33.484623 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-975baa44-fc28-4925-9258-f746adf7f31c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:33.552002 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-975baa44-fc28-4925-9258-f746adf7f31c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:33.559393 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-975baa44-fc28-4925-9258-f746adf7f31c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1237 microversion: 2.1 time: 0.090359 Jun 16 21:18:33.559953 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 404/852] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:33 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1237 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:34.436606 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-fef6e5a7-803e-4fce-abdc-70d4fc10cfbd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:34.437216 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-fef6e5a7-803e-4fce-abdc-70d4fc10cfbd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:34.443716 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fef6e5a7-803e-4fce-abdc-70d4fc10cfbd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:34.444159 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fef6e5a7-803e-4fce-abdc-70d4fc10cfbd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:34.444937 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fef6e5a7-803e-4fce-abdc-70d4fc10cfbd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:34.445366 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fef6e5a7-803e-4fce-abdc-70d4fc10cfbd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:34.573589 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-fef6e5a7-803e-4fce-abdc-70d4fc10cfbd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:34.577780 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6a132535-1463-4326-ae68-02cf8a2b8d3c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:34.578406 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6a132535-1463-4326-ae68-02cf8a2b8d3c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:34.582339 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-fef6e5a7-803e-4fce-abdc-70d4fc10cfbd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1737 microversion: 2.1 time: 0.149544 Jun 16 21:18:34.582911 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 449/853] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:34 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:34.585629 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6a132535-1463-4326-ae68-02cf8a2b8d3c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:34.586080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6a132535-1463-4326-ae68-02cf8a2b8d3c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:34.586855 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6a132535-1463-4326-ae68-02cf8a2b8d3c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:34.587289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6a132535-1463-4326-ae68-02cf8a2b8d3c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:34.655914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6a132535-1463-4326-ae68-02cf8a2b8d3c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:34.664679 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6a132535-1463-4326-ae68-02cf8a2b8d3c tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1301 microversion: 2.1 time: 0.090606 Jun 16 21:18:34.666313 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 405/854] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:34 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:35.539521 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4af30493-2701-4904-8899-0f5459957d6e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-550072689"}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:35.540056 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4af30493-2701-4904-8899-0f5459957d6e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:35.546574 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4af30493-2701-4904-8899-0f5459957d6e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:35.547017 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4af30493-2701-4904-8899-0f5459957d6e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:35.547769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4af30493-2701-4904-8899-0f5459957d6e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:35.548213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4af30493-2701-4904-8899-0f5459957d6e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:35.599203 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-484dc7c1-9b4a-4fcd-b658-7ae8ccb40894 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:35.599900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-484dc7c1-9b4a-4fcd-b658-7ae8ccb40894 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:35.606474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-484dc7c1-9b4a-4fcd-b658-7ae8ccb40894 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:35.606917 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-484dc7c1-9b4a-4fcd-b658-7ae8ccb40894 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:35.607714 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-484dc7c1-9b4a-4fcd-b658-7ae8ccb40894 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:35.608146 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-484dc7c1-9b4a-4fcd-b658-7ae8ccb40894 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:35.730207 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.network.security_group_api [None req-4af30493-2701-4904-8899-0f5459957d6e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Removing security group c19dd2ec-0bff-4018-916c-55304561aea6 from port f26fce3f-5e61-4002-98b6-275c3b72e9db Jun 16 21:18:35.746519 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-484dc7c1-9b4a-4fcd-b658-7ae8ccb40894 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:35.755386 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-484dc7c1-9b4a-4fcd-b658-7ae8ccb40894 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1717 microversion: 2.1 time: 0.160159 Jun 16 21:18:35.755949 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 406/855] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:35 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:35.760419 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4234b9fb-9790-4a7d-8265-7798648d106b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:35.761042 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4234b9fb-9790-4a7d-8265-7798648d106b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:35.767074 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4234b9fb-9790-4a7d-8265-7798648d106b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:35.767431 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4234b9fb-9790-4a7d-8265-7798648d106b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:35.768585 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4234b9fb-9790-4a7d-8265-7798648d106b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:35.769280 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4234b9fb-9790-4a7d-8265-7798648d106b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:35.924195 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4234b9fb-9790-4a7d-8265-7798648d106b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:35.932877 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4234b9fb-9790-4a7d-8265-7798648d106b tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1367 microversion: 2.1 time: 0.175875 Jun 16 21:18:35.933461 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 407/856] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:35 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:35.938086 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-ec308d5b-8fd2-4627-b296-d18e23d2d3b9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:35.938709 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-ec308d5b-8fd2-4627-b296-d18e23d2d3b9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:35.945625 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ec308d5b-8fd2-4627-b296-d18e23d2d3b9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:35.946078 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ec308d5b-8fd2-4627-b296-d18e23d2d3b9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:35.946853 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ec308d5b-8fd2-4627-b296-d18e23d2d3b9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:35.947285 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ec308d5b-8fd2-4627-b296-d18e23d2d3b9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:36.028682 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-ec308d5b-8fd2-4627-b296-d18e23d2d3b9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] HTTP exception thrown: Cannot 'detach_volume' instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 while it is in vm_state rescued Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-ec308d5b-8fd2-4627-b296-d18e23d2d3b9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Request method failure captured: Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: DELETE /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/os-volume_attachments/27c4460e-f225-4d5b-bb8d-c91ea0b2f456 HTTP/1.1 Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq507epJ_aTadF1Dd3rdHpBGlGRf4wX2wIMRrVEIy3GJv1cGUncdSTggT3o9d1eY2ow3SkuABL36GC1u31rXJx0UKPHWR1fNJBZP9pTZGMEU61bDRMu4A9RHCrRkLu91ThMUkD7yCVbJCHJ74gAcATick2BtzDKets9fD-77KD88q3xc Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 6b341c2d77764f3890f2501cfc6945a7 Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-273390268 Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:18:36.030297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:18:36.031881 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b341c2d77764f3890f2501cfc6945a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6b341c2d77764f3890f2501cfc6945a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b341c2d77764f3890f2501cfc6945a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6b341c2d77764f3890f2501cfc6945a7"}]}] Jun 16 21:18:36.031881 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-ServerRescueNegativeTestJSON-273390268 Jun 16 21:18:36.031881 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 6b341c2d77764f3890f2501cfc6945a7 Jun 16 21:18:36.031881 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-273390268 Jun 16 21:18:36.031881 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-ServerRescueNegativeTestJSON-273390268-project Jun 16 21:18:36.031881 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:18:36.031881 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:18:36.031881 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 1d410832e6584828875128e31baa0ae8 Jun 16 21:18:36.031881 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-ServerRescueNegativeTestJSON-273390268-project Jun 16 21:18:36.031881 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:18:36.031881 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Cannot 'detach_volume' instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 while it is in vm_state rescued Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'server_id': '24b1c256-3ab9-4d48-a2d3-eca09c3159f1', 'id': '27c4460e-f225-4d5b-bb8d-c91ea0b2f456'} Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:18:36.032712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:18:36.034819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 21:18:36.034819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 21:18:36.034819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 21:18:36.034819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 21:18:36.034819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 while it is in vm_state rescued Jun 16 21:18:36.034819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:18:36.034819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:18:36.034819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:18:36.034819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:36.034819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:18:36.034819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:18:36.034819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:18:36.034819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:18:36.034819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 while it is in vm_state rescued Jun 16 21:18:36.034819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:18:36.034819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-ec308d5b-8fd2-4627-b296-d18e23d2d3b9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Returning 409 to user: Cannot 'detach_volume' instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 while it is in vm_state rescued {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:18:36.036015 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-ec308d5b-8fd2-4627-b296-d18e23d2d3b9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "DELETE /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/os-volume_attachments/27c4460e-f225-4d5b-bb8d-c91ea0b2f456" status: 409 len: 152 microversion: 2.1 time: 0.097283 Jun 16 21:18:36.036015 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 408/857] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 16 21:18:35 2022] DELETE /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/os-volume_attachments/27c4460e-f225-4d5b-bb8d-c91ea0b2f456 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 21:18:36.044505 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1e7109b7-e854-4b1b-b9a5-84fdf0d62887 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:36.045039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1e7109b7-e854-4b1b-b9a5-84fdf0d62887 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:36.051623 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1e7109b7-e854-4b1b-b9a5-84fdf0d62887 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:36.052086 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1e7109b7-e854-4b1b-b9a5-84fdf0d62887 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:36.052965 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1e7109b7-e854-4b1b-b9a5-84fdf0d62887 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:36.053401 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1e7109b7-e854-4b1b-b9a5-84fdf0d62887 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:36.121280 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1e7109b7-e854-4b1b-b9a5-84fdf0d62887 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "POST /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/action" status: 202 len: 0 microversion: 2.1 time: 0.080332 Jun 16 21:18:36.122133 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 409/858] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 16 21:18:36 2022] POST /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 21:18:36.132253 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9eb1bc9e-564a-495f-97fa-8a075bce4d83 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:36.133437 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-9eb1bc9e-564a-495f-97fa-8a075bce4d83 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:36.140437 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9eb1bc9e-564a-495f-97fa-8a075bce4d83 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:36.141452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9eb1bc9e-564a-495f-97fa-8a075bce4d83 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:36.143066 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9eb1bc9e-564a-495f-97fa-8a075bce4d83 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:36.143652 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9eb1bc9e-564a-495f-97fa-8a075bce4d83 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:36.162124 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:36.288123 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9eb1bc9e-564a-495f-97fa-8a075bce4d83 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:36.296130 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-9eb1bc9e-564a-495f-97fa-8a075bce4d83 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1725 microversion: 2.1 time: 0.169265 Jun 16 21:18:36.296713 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 410/859] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:36 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:36.536217 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4af30493-2701-4904-8899-0f5459957d6e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "POST /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/action" status: 202 len: 0 microversion: 2.1 time: 1.000487 Jun 16 21:18:36.538049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 450/860] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 16 21:18:35 2022] POST /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/action => generated 0 bytes in 1002 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:18:36.667430 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-3df90536-fe17-4d01-9882-292991ab8640 req-2cbfb81f-fe47-4ed3-958d-7b0ba03c1f51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec1e2cd-9bb8-4602-9f96-77478cfc9af8", "tag": "f26fce3f-5e61-4002-98b6-275c3b72e9db"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:36.686831 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-3df90536-fe17-4d01-9882-292991ab8640 req-2cbfb81f-fe47-4ed3-958d-7b0ba03c1f51 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:36.687520 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-3df90536-fe17-4d01-9882-292991ab8640 req-2cbfb81f-fe47-4ed3-958d-7b0ba03c1f51 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:36.705722 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-3df90536-fe17-4d01-9882-292991ab8640 req-2cbfb81f-fe47-4ed3-958d-7b0ba03c1f51 service nova] Creating event network-changed:f26fce3f-5e61-4002-98b6-275c3b72e9db for instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 on hv-cinder-81914 Jun 16 21:18:36.714472 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-3df90536-fe17-4d01-9882-292991ab8640 req-2cbfb81f-fe47-4ed3-958d-7b0ba03c1f51 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158545 Jun 16 21:18:36.715567 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 411/861] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:36.951304 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-11eff901-569e-4eeb-85ce-3acf53e0ae82 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:36.952152 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-11eff901-569e-4eeb-85ce-3acf53e0ae82 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:36.964257 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-11eff901-569e-4eeb-85ce-3acf53e0ae82 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:36.965304 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-11eff901-569e-4eeb-85ce-3acf53e0ae82 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:36.967181 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-11eff901-569e-4eeb-85ce-3acf53e0ae82 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:36.967942 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-11eff901-569e-4eeb-85ce-3acf53e0ae82 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:37.322140 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-f97f2c09-cb33-497e-9a2f-b36870ea2a5e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:37.323107 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-f97f2c09-cb33-497e-9a2f-b36870ea2a5e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:37.335864 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f97f2c09-cb33-497e-9a2f-b36870ea2a5e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:37.336391 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f97f2c09-cb33-497e-9a2f-b36870ea2a5e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:37.337515 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f97f2c09-cb33-497e-9a2f-b36870ea2a5e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:37.338108 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f97f2c09-cb33-497e-9a2f-b36870ea2a5e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:37.539553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-f97f2c09-cb33-497e-9a2f-b36870ea2a5e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:37.554297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-f97f2c09-cb33-497e-9a2f-b36870ea2a5e tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1725 microversion: 2.1 time: 0.240653 Jun 16 21:18:37.555153 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 412/862] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:37 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:37.738753 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-11eff901-569e-4eeb-85ce-3acf53e0ae82 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:37.746582 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-11eff901-569e-4eeb-85ce-3acf53e0ae82 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1367 microversion: 2.1 time: 0.799822 Jun 16 21:18:37.747160 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 451/863] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:36 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1367 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:38.573840 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1d6728d5-a739-42c8-b6f6-fb383aa7ddd6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:38.574227 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1d6728d5-a739-42c8-b6f6-fb383aa7ddd6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:38.582899 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1d6728d5-a739-42c8-b6f6-fb383aa7ddd6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:38.583348 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1d6728d5-a739-42c8-b6f6-fb383aa7ddd6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:38.584121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1d6728d5-a739-42c8-b6f6-fb383aa7ddd6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:38.584601 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1d6728d5-a739-42c8-b6f6-fb383aa7ddd6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:38.623861 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-22c0247c-415b-4cab-93d9-8d29e2a84cb3 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:38.624496 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-22c0247c-415b-4cab-93d9-8d29e2a84cb3 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:38.632118 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-22c0247c-415b-4cab-93d9-8d29e2a84cb3 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:38.632723 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-22c0247c-415b-4cab-93d9-8d29e2a84cb3 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:38.633493 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-22c0247c-415b-4cab-93d9-8d29e2a84cb3 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:38.633919 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-22c0247c-415b-4cab-93d9-8d29e2a84cb3 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:38.718245 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.objects.instance [None req-22c0247c-415b-4cab-93d9-8d29e2a84cb3 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lazy-loading 'services' on Instance uuid 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 {{(pid=117737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:18:38.739859 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1d6728d5-a739-42c8-b6f6-fb383aa7ddd6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:38.748335 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1d6728d5-a739-42c8-b6f6-fb383aa7ddd6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1725 microversion: 2.1 time: 0.179736 Jun 16 21:18:38.749079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 413/864] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:38 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:38.756714 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-4313f857-441d-4f8e-ab76-9051c7dae0c9 req-c615d361-6fc2-4237-9fcf-25cbcc7fc505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b46c41-400a-4a80-9bcf-d07fcfd34a18", "tag": "888667cf-09a8-4cc3-8749-acf758b60412"}, {"name": "network-changed", "server_uuid": "4ec1e2cd-9bb8-4602-9f96-77478cfc9af8", "tag": "f26fce3f-5e61-4002-98b6-275c3b72e9db"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:38.767545 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-4313f857-441d-4f8e-ab76-9051c7dae0c9 req-c615d361-6fc2-4237-9fcf-25cbcc7fc505 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:38.767934 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-4313f857-441d-4f8e-ab76-9051c7dae0c9 req-c615d361-6fc2-4237-9fcf-25cbcc7fc505 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:38.781659 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-4313f857-441d-4f8e-ab76-9051c7dae0c9 req-c615d361-6fc2-4237-9fcf-25cbcc7fc505 service nova] Creating event network-changed:888667cf-09a8-4cc3-8749-acf758b60412 for instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 on hv-cinder-81914 Jun 16 21:18:38.782201 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-4313f857-441d-4f8e-ab76-9051c7dae0c9 req-c615d361-6fc2-4237-9fcf-25cbcc7fc505 service nova] Creating event network-changed:f26fce3f-5e61-4002-98b6-275c3b72e9db for instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 on hv-cinder-81914 Jun 16 21:18:38.789621 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-4313f857-441d-4f8e-ab76-9051c7dae0c9 req-c615d361-6fc2-4237-9fcf-25cbcc7fc505 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038563 Jun 16 21:18:38.790244 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 414/865] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:38.796304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-22059d62-37f6-4709-8bf6-4db4cc0d9d92 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:38.797139 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-22059d62-37f6-4709-8bf6-4db4cc0d9d92 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:38.805042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-22c0247c-415b-4cab-93d9-8d29e2a84cb3 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/os-volume_attachments/90c50714-d19e-46e9-8a36-0cb86d68845e" status: 202 len: 0 microversion: 2.1 time: 0.184778 Jun 16 21:18:38.805643 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 452/866] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 16 21:18:38 2022] DELETE /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/os-volume_attachments/90c50714-d19e-46e9-8a36-0cb86d68845e => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 21:18:38.806626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-22059d62-37f6-4709-8bf6-4db4cc0d9d92 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:38.807092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-22059d62-37f6-4709-8bf6-4db4cc0d9d92 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:38.807876 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-22059d62-37f6-4709-8bf6-4db4cc0d9d92 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:38.808355 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-22059d62-37f6-4709-8bf6-4db4cc0d9d92 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:38.814360 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9141abd4-9393-4be0-b843-0bc5d9cc7784 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:38.816085 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-9141abd4-9393-4be0-b843-0bc5d9cc7784 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:38.822504 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9141abd4-9393-4be0-b843-0bc5d9cc7784 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:38.822952 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9141abd4-9393-4be0-b843-0bc5d9cc7784 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:38.823706 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9141abd4-9393-4be0-b843-0bc5d9cc7784 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:38.824358 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9141abd4-9393-4be0-b843-0bc5d9cc7784 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:38.856649 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9141abd4-9393-4be0-b843-0bc5d9cc7784 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046292 Jun 16 21:18:38.857582 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 453/867] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:18:38 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:38.946755 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-22059d62-37f6-4709-8bf6-4db4cc0d9d92 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:38.954285 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-22059d62-37f6-4709-8bf6-4db4cc0d9d92 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1367 microversion: 2.1 time: 0.162788 Jun 16 21:18:38.954851 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 415/868] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:38 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:39.766859 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4a8112bd-2d3a-4e72-a041-60805fd3d9fa tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:39.767498 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4a8112bd-2d3a-4e72-a041-60805fd3d9fa tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:39.773914 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4a8112bd-2d3a-4e72-a041-60805fd3d9fa tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:39.774349 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4a8112bd-2d3a-4e72-a041-60805fd3d9fa tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:39.775099 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4a8112bd-2d3a-4e72-a041-60805fd3d9fa tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:39.775523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4a8112bd-2d3a-4e72-a041-60805fd3d9fa tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:39.869615 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b29ac11f-a2e8-4e70-ad4c-e89d23b92bd4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:39.870544 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b29ac11f-a2e8-4e70-ad4c-e89d23b92bd4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:39.877036 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b29ac11f-a2e8-4e70-ad4c-e89d23b92bd4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:39.878174 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b29ac11f-a2e8-4e70-ad4c-e89d23b92bd4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:39.879005 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b29ac11f-a2e8-4e70-ad4c-e89d23b92bd4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:39.879412 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b29ac11f-a2e8-4e70-ad4c-e89d23b92bd4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:39.906860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4a8112bd-2d3a-4e72-a041-60805fd3d9fa tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:39.907765 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b29ac11f-a2e8-4e70-ad4c-e89d23b92bd4 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042415 Jun 16 21:18:39.908371 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 416/869] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:18:39 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:18:39.915207 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4a8112bd-2d3a-4e72-a041-60805fd3d9fa tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1725 microversion: 2.1 time: 0.152173 Jun 16 21:18:39.915766 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 454/870] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:39 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:39.971140 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-dacca3b8-0d32-41f8-a683-2e665a5bccd2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:39.972440 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-dacca3b8-0d32-41f8-a683-2e665a5bccd2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:39.978316 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-dacca3b8-0d32-41f8-a683-2e665a5bccd2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:39.978765 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-dacca3b8-0d32-41f8-a683-2e665a5bccd2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:39.979527 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-dacca3b8-0d32-41f8-a683-2e665a5bccd2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:39.979975 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-dacca3b8-0d32-41f8-a683-2e665a5bccd2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:40.107855 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-dacca3b8-0d32-41f8-a683-2e665a5bccd2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:40.117286 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-dacca3b8-0d32-41f8-a683-2e665a5bccd2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1367 microversion: 2.1 time: 0.149570 Jun 16 21:18:40.117854 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 417/871] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:39 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:40.919778 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4cb9f961-7696-4a87-a67a-72b419f5b874 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:40.920688 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4cb9f961-7696-4a87-a67a-72b419f5b874 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:40.928458 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4cb9f961-7696-4a87-a67a-72b419f5b874 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:40.928901 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4cb9f961-7696-4a87-a67a-72b419f5b874 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:40.929670 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4cb9f961-7696-4a87-a67a-72b419f5b874 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:40.930184 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4cb9f961-7696-4a87-a67a-72b419f5b874 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:40.933856 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6a7588d6-5de2-4112-9bc6-df2d44141b2a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:40.934473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6a7588d6-5de2-4112-9bc6-df2d44141b2a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:40.941244 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6a7588d6-5de2-4112-9bc6-df2d44141b2a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:40.941689 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6a7588d6-5de2-4112-9bc6-df2d44141b2a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:40.942461 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6a7588d6-5de2-4112-9bc6-df2d44141b2a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:40.942892 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6a7588d6-5de2-4112-9bc6-df2d44141b2a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:40.959895 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4cb9f961-7696-4a87-a67a-72b419f5b874 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044122 Jun 16 21:18:40.960483 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 455/872] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:18:40 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:41.074221 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6a7588d6-5de2-4112-9bc6-df2d44141b2a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:41.082982 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6a7588d6-5de2-4112-9bc6-df2d44141b2a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1725 microversion: 2.1 time: 0.153971 Jun 16 21:18:41.083781 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 418/873] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:40 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:41.134149 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d33113e3-085c-40db-be16-3b7fa24afd90 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:41.134958 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d33113e3-085c-40db-be16-3b7fa24afd90 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:41.141154 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d33113e3-085c-40db-be16-3b7fa24afd90 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:41.141601 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d33113e3-085c-40db-be16-3b7fa24afd90 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:41.142360 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d33113e3-085c-40db-be16-3b7fa24afd90 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:41.142792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d33113e3-085c-40db-be16-3b7fa24afd90 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:41.274546 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d33113e3-085c-40db-be16-3b7fa24afd90 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:41.282298 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d33113e3-085c-40db-be16-3b7fa24afd90 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1367 microversion: 2.1 time: 0.151917 Jun 16 21:18:41.282983 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 456/874] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:41 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:41.971015 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-bed117e0-a191-43fe-b422-ad5445150ed8 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:41.973237 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-bed117e0-a191-43fe-b422-ad5445150ed8 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:41.980375 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bed117e0-a191-43fe-b422-ad5445150ed8 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:41.980804 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bed117e0-a191-43fe-b422-ad5445150ed8 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:41.981922 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bed117e0-a191-43fe-b422-ad5445150ed8 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:41.982582 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bed117e0-a191-43fe-b422-ad5445150ed8 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:42.012821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-bed117e0-a191-43fe-b422-ad5445150ed8 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045727 Jun 16 21:18:42.013693 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 419/875] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:18:41 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 21:18:42.023879 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e47ab2ea-d0b2-4667-a647-38e61c8b5523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:42.024515 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e47ab2ea-d0b2-4667-a647-38e61c8b5523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:42.030959 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e47ab2ea-d0b2-4667-a647-38e61c8b5523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:42.031477 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e47ab2ea-d0b2-4667-a647-38e61c8b5523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:42.032367 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e47ab2ea-d0b2-4667-a647-38e61c8b5523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:42.032959 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e47ab2ea-d0b2-4667-a647-38e61c8b5523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:42.100812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-58cf07bb-fdc0-4544-9382-95f324fd7863 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:42.101923 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-58cf07bb-fdc0-4544-9382-95f324fd7863 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:42.108367 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-58cf07bb-fdc0-4544-9382-95f324fd7863 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:42.108819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-58cf07bb-fdc0-4544-9382-95f324fd7863 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:42.109840 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-58cf07bb-fdc0-4544-9382-95f324fd7863 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:42.110142 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-e47ab2ea-d0b2-4667-a647-38e61c8b5523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] HTTP exception thrown: Instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 is not attached to volume 90c50714-d19e-46e9-8a36-0cb86d68845e Jun 16 21:18:42.110304 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-58cf07bb-fdc0-4544-9382-95f324fd7863 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e47ab2ea-d0b2-4667-a647-38e61c8b5523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Request method failure captured: Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: DELETE /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/os-volume_attachments/90c50714-d19e-46e9-8a36-0cb86d68845e HTTP/1.1 Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq51cHW2GbcoU2tA5l9J9PkoGADS-ZtBTNDY4Q1dEV4j2f95dQ2PCGjzgN_fGqklQ7D4wzuzMhkNJItXsd68jYgUOJJ6Rezqc3LdgTe1wMFqjFk9LWq0KPfbKsVF56dlyy3e6b3phpf-5lQIFWSFsOXXQDJRr4glhISzLhvuc_tzIek4 Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: df862b955995466a84bc189d9098d7ce Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-TestMinimumBasicScenario-1623586547 Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:18:42.113127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:18:42.114436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/df862b955995466a84bc189d9098d7ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_df862b955995466a84bc189d9098d7ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/df862b955995466a84bc189d9098d7ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/df862b955995466a84bc189d9098d7ce"}]}] Jun 16 21:18:42.114436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-TestMinimumBasicScenario-1623586547 Jun 16 21:18:42.114436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: df862b955995466a84bc189d9098d7ce Jun 16 21:18:42.114436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1623586547 Jun 16 21:18:42.114436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-TestMinimumBasicScenario-1623586547-project Jun 16 21:18:42.114436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:18:42.114436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:18:42.114436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 573eab511f4f41b78614247c0f4b99a1 Jun 16 21:18:42.114436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-TestMinimumBasicScenario-1623586547-project Jun 16 21:18:42.114436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:18:42.114436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 is not attached to volume 90c50714-d19e-46e9-8a36-0cb86d68845e Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'server_id': '4ec1e2cd-9bb8-4602-9f96-77478cfc9af8', 'id': '90c50714-d19e-46e9-8a36-0cb86d68845e'} Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 90c50714-d19e-46e9-8a36-0cb86d68845e. Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:18:42.115131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:18:42.116265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:18:42.116265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 21:18:42.116265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 21:18:42.116265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 is not attached to volume 90c50714-d19e-46e9-8a36-0cb86d68845e Jun 16 21:18:42.116265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:18:42.116265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:18:42.116265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:18:42.116265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:42.116265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:18:42.116265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:18:42.116265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:18:42.116265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:18:42.116265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 is not attached to volume 90c50714-d19e-46e9-8a36-0cb86d68845e Jun 16 21:18:42.116265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:18:42.119003 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e47ab2ea-d0b2-4667-a647-38e61c8b5523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Returning 404 to user: Instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 is not attached to volume 90c50714-d19e-46e9-8a36-0cb86d68845e {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:18:42.120152 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e47ab2ea-d0b2-4667-a647-38e61c8b5523 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/os-volume_attachments/90c50714-d19e-46e9-8a36-0cb86d68845e" status: 404 len: 154 microversion: 2.1 time: 0.100417 Jun 16 21:18:42.121266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 457/876] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 16 21:18:42 2022] DELETE /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8/os-volume_attachments/90c50714-d19e-46e9-8a36-0cb86d68845e => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:18:42.254483 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-58cf07bb-fdc0-4544-9382-95f324fd7863 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:42.262590 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-58cf07bb-fdc0-4544-9382-95f324fd7863 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1731 microversion: 2.1 time: 0.166035 Jun 16 21:18:42.272700 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 420/877] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:42 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:42.279433 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d07244c5-bf52-4398-910f-c5c041145d05 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:42.279930 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d07244c5-bf52-4398-910f-c5c041145d05 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:42.286489 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d07244c5-bf52-4398-910f-c5c041145d05 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:42.286934 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d07244c5-bf52-4398-910f-c5c041145d05 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:42.287701 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d07244c5-bf52-4398-910f-c5c041145d05 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:42.288132 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d07244c5-bf52-4398-910f-c5c041145d05 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:42.291850 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:42.302261 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8272ad18-2cfd-43a1-bd10-f5022a808c17 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:42.303604 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8272ad18-2cfd-43a1-bd10-f5022a808c17 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:42.310363 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8272ad18-2cfd-43a1-bd10-f5022a808c17 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:42.310901 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8272ad18-2cfd-43a1-bd10-f5022a808c17 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:42.311259 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:42.311865 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8272ad18-2cfd-43a1-bd10-f5022a808c17 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:42.312317 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8272ad18-2cfd-43a1-bd10-f5022a808c17 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:42.328543 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=10 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:42.406410 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d07244c5-bf52-4398-910f-c5c041145d05 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130259 Jun 16 21:18:42.407295 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 458/878] 10.222.0.43 () {58 vars in 1274 bytes} [Thu Jun 16 21:18:42 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:42.451030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8272ad18-2cfd-43a1-bd10-f5022a808c17 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:42.453685 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=2 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:42.461749 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8272ad18-2cfd-43a1-bd10-f5022a808c17 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1367 microversion: 2.1 time: 0.163250 Jun 16 21:18:42.462332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 421/879] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:42 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:43.282094 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c920a77a-83cc-4073-92f0-86182b91790c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:43.284472 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c920a77a-83cc-4073-92f0-86182b91790c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:43.293277 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c920a77a-83cc-4073-92f0-86182b91790c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:43.294899 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c920a77a-83cc-4073-92f0-86182b91790c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:43.295914 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c920a77a-83cc-4073-92f0-86182b91790c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:43.296557 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c920a77a-83cc-4073-92f0-86182b91790c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:43.329513 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c920a77a-83cc-4073-92f0-86182b91790c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Going to try to terminate instance {{(pid=117737) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:18:43.467391 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c920a77a-83cc-4073-92f0-86182b91790c tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 204 len: 0 microversion: 2.1 time: 0.190631 Jun 16 21:18:43.468331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 459/880] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:18:43 2022] DELETE /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:18:43.470410 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-38045e4b-08fa-4ada-8486-cc2241a472a5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:43.473344 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-38045e4b-08fa-4ada-8486-cc2241a472a5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:43.478484 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-108397ff-2ad1-4bf5-8068-7d5f2cc98974 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:43.479289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-108397ff-2ad1-4bf5-8068-7d5f2cc98974 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:43.482285 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-38045e4b-08fa-4ada-8486-cc2241a472a5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:43.483479 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-38045e4b-08fa-4ada-8486-cc2241a472a5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:43.484627 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-38045e4b-08fa-4ada-8486-cc2241a472a5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:43.485703 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-38045e4b-08fa-4ada-8486-cc2241a472a5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:43.486792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-108397ff-2ad1-4bf5-8068-7d5f2cc98974 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:43.487974 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-108397ff-2ad1-4bf5-8068-7d5f2cc98974 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:43.489494 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-108397ff-2ad1-4bf5-8068-7d5f2cc98974 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:43.490444 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-108397ff-2ad1-4bf5-8068-7d5f2cc98974 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:43.521659 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-38045e4b-08fa-4ada-8486-cc2241a472a5 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057248 Jun 16 21:18:43.522909 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 422/881] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:18:43 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 21:18:43.528557 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4e036492-da2c-4516-bad5-65f28be40893 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:43.529610 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4e036492-da2c-4516-bad5-65f28be40893 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:43.537564 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4e036492-da2c-4516-bad5-65f28be40893 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:43.538241 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4e036492-da2c-4516-bad5-65f28be40893 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:43.539205 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4e036492-da2c-4516-bad5-65f28be40893 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:43.539785 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4e036492-da2c-4516-bad5-65f28be40893 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:43.700411 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4e036492-da2c-4516-bad5-65f28be40893 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:43.708613 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4e036492-da2c-4516-bad5-65f28be40893 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1367 microversion: 2.1 time: 0.184420 Jun 16 21:18:43.709489 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 423/882] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:43 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:43.713710 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1d40ab67-cea5-4378-9ba5-3d662a36a22f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:43.714210 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1d40ab67-cea5-4378-9ba5-3d662a36a22f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:43.720270 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1d40ab67-cea5-4378-9ba5-3d662a36a22f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:43.720738 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1d40ab67-cea5-4378-9ba5-3d662a36a22f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:43.721593 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1d40ab67-cea5-4378-9ba5-3d662a36a22f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:43.722035 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1d40ab67-cea5-4378-9ba5-3d662a36a22f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:43.746629 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1d40ab67-cea5-4378-9ba5-3d662a36a22f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Going to try to terminate instance {{(pid=117738) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:18:43.835016 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1d40ab67-cea5-4378-9ba5-3d662a36a22f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "DELETE /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 204 len: 0 microversion: 2.1 time: 0.124415 Jun 16 21:18:43.835877 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 424/883] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:18:43 2022] DELETE /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:18:43.844056 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c3924a49-8ae7-4a3e-a167-eeb6bf4e8925 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:43.844799 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c3924a49-8ae7-4a3e-a167-eeb6bf4e8925 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:43.850863 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c3924a49-8ae7-4a3e-a167-eeb6bf4e8925 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:43.851315 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c3924a49-8ae7-4a3e-a167-eeb6bf4e8925 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:43.852090 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c3924a49-8ae7-4a3e-a167-eeb6bf4e8925 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:43.852558 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c3924a49-8ae7-4a3e-a167-eeb6bf4e8925 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:43.855555 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-108397ff-2ad1-4bf5-8068-7d5f2cc98974 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:43.863553 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-108397ff-2ad1-4bf5-8068-7d5f2cc98974 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1555 microversion: 2.1 time: 0.389728 Jun 16 21:18:43.865127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 460/884] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:43 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1555 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:43.872252 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-fddd8068-e94e-4643-8175-dbf0f51fafc1 req-0d0adbd6-fd34-45d3-983e-4cf710980c07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24b1c256-3ab9-4d48-a2d3-eca09c3159f1", "tag": "05b93a42-bdde-493e-9e4e-b676213111c0"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:43.885010 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-fddd8068-e94e-4643-8175-dbf0f51fafc1 req-0d0adbd6-fd34-45d3-983e-4cf710980c07 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:43.886485 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-fddd8068-e94e-4643-8175-dbf0f51fafc1 req-0d0adbd6-fd34-45d3-983e-4cf710980c07 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:43.901626 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-fddd8068-e94e-4643-8175-dbf0f51fafc1 req-0d0adbd6-fd34-45d3-983e-4cf710980c07 service nova] Creating event network-changed:05b93a42-bdde-493e-9e4e-b676213111c0 for instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 on hv-cinder-81914 Jun 16 21:18:43.907472 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-fddd8068-e94e-4643-8175-dbf0f51fafc1 req-0d0adbd6-fd34-45d3-983e-4cf710980c07 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040206 Jun 16 21:18:43.907669 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 461/885] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:43.987475 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c3924a49-8ae7-4a3e-a167-eeb6bf4e8925 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:43.995475 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c3924a49-8ae7-4a3e-a167-eeb6bf4e8925 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1673 microversion: 2.1 time: 0.155404 Jun 16 21:18:43.996041 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 425/886] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:43 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:44.727601 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9219b3b4-ae59-42db-9632-0ece65f6476a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:44.728331 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-9219b3b4-ae59-42db-9632-0ece65f6476a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:44.734675 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9219b3b4-ae59-42db-9632-0ece65f6476a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:44.735291 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9219b3b4-ae59-42db-9632-0ece65f6476a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:44.736102 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9219b3b4-ae59-42db-9632-0ece65f6476a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:44.736632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9219b3b4-ae59-42db-9632-0ece65f6476a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:44.871644 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9219b3b4-ae59-42db-9632-0ece65f6476a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:44.880270 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9219b3b4-ae59-42db-9632-0ece65f6476a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1367 microversion: 2.1 time: 0.157784 Jun 16 21:18:44.880838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 462/887] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:44 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:44.882210 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-12b53ca2-afc1-4e16-88f0-6d6fba812ca6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:44.882856 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-12b53ca2-afc1-4e16-88f0-6d6fba812ca6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:44.889328 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-12b53ca2-afc1-4e16-88f0-6d6fba812ca6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:44.889773 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-12b53ca2-afc1-4e16-88f0-6d6fba812ca6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:44.890533 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-12b53ca2-afc1-4e16-88f0-6d6fba812ca6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:44.890963 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-12b53ca2-afc1-4e16-88f0-6d6fba812ca6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:45.013325 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9bfcc12c-cafd-4ca5-a488-e1c565b8f5fc tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:45.013929 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-9bfcc12c-cafd-4ca5-a488-e1c565b8f5fc tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:45.020385 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9bfcc12c-cafd-4ca5-a488-e1c565b8f5fc tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:45.020821 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9bfcc12c-cafd-4ca5-a488-e1c565b8f5fc tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:45.021572 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9bfcc12c-cafd-4ca5-a488-e1c565b8f5fc tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:45.021998 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9bfcc12c-cafd-4ca5-a488-e1c565b8f5fc tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:45.025262 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-12b53ca2-afc1-4e16-88f0-6d6fba812ca6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:45.027625 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:45.034719 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-12b53ca2-afc1-4e16-88f0-6d6fba812ca6 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1555 microversion: 2.1 time: 0.156418 Jun 16 21:18:45.035414 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 426/888] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:44 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:45.188349 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9bfcc12c-cafd-4ca5-a488-e1c565b8f5fc tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:45.196235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9bfcc12c-cafd-4ca5-a488-e1c565b8f5fc tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1673 microversion: 2.1 time: 0.186671 Jun 16 21:18:45.196808 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 463/889] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:45 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1673 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:45.373140 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-6b43b54e-7850-4297-b0c0-6c0d00736beb req-6740931d-3fb1-4eef-b395-9b26b5e675e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b46c41-400a-4a80-9bcf-d07fcfd34a18", "name": "network-vif-plugged", "status": "completed", "tag": "888667cf-09a8-4cc3-8749-acf758b60412"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:45.381866 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-6b43b54e-7850-4297-b0c0-6c0d00736beb req-6740931d-3fb1-4eef-b395-9b26b5e675e7 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:45.382302 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-6b43b54e-7850-4297-b0c0-6c0d00736beb req-6740931d-3fb1-4eef-b395-9b26b5e675e7 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:45.393645 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-6b43b54e-7850-4297-b0c0-6c0d00736beb req-6740931d-3fb1-4eef-b395-9b26b5e675e7 service nova] Creating event network-vif-plugged:888667cf-09a8-4cc3-8749-acf758b60412 for instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 on hv-cinder-81914 Jun 16 21:18:45.398341 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-6b43b54e-7850-4297-b0c0-6c0d00736beb req-6740931d-3fb1-4eef-b395-9b26b5e675e7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029505 Jun 16 21:18:45.398925 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 427/890] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:45.897623 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a2d52551-ede6-430c-b8b1-7d4c21f88954 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:45.898134 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a2d52551-ede6-430c-b8b1-7d4c21f88954 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:45.904631 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a2d52551-ede6-430c-b8b1-7d4c21f88954 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:45.905070 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a2d52551-ede6-430c-b8b1-7d4c21f88954 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:45.905817 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a2d52551-ede6-430c-b8b1-7d4c21f88954 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:45.906244 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a2d52551-ede6-430c-b8b1-7d4c21f88954 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:45.923444 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-7d287ef2-a425-45a4-b3ac-6457ade627d5 req-cef95970-7151-4d8f-bfec-e15fdf4ce418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24b1c256-3ab9-4d48-a2d3-eca09c3159f1", "tag": "05b93a42-bdde-493e-9e4e-b676213111c0"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:45.931670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-7d287ef2-a425-45a4-b3ac-6457ade627d5 req-cef95970-7151-4d8f-bfec-e15fdf4ce418 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:45.932106 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-7d287ef2-a425-45a4-b3ac-6457ade627d5 req-cef95970-7151-4d8f-bfec-e15fdf4ce418 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:45.944377 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-7d287ef2-a425-45a4-b3ac-6457ade627d5 req-cef95970-7151-4d8f-bfec-e15fdf4ce418 service nova] Creating event network-changed:05b93a42-bdde-493e-9e4e-b676213111c0 for instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 on hv-cinder-81914 Jun 16 21:18:45.950669 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-7d287ef2-a425-45a4-b3ac-6457ade627d5 req-cef95970-7151-4d8f-bfec-e15fdf4ce418 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031591 Jun 16 21:18:45.951265 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 428/891] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:18:46.041037 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a2d52551-ede6-430c-b8b1-7d4c21f88954 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:46.048391 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a2d52551-ede6-430c-b8b1-7d4c21f88954 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1367 microversion: 2.1 time: 0.155200 Jun 16 21:18:46.049045 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 464/892] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:45 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:46.052633 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8983ebfd-3638-496c-9be5-d8559f2d1eaf tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:46.053332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8983ebfd-3638-496c-9be5-d8559f2d1eaf tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:46.059542 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8983ebfd-3638-496c-9be5-d8559f2d1eaf tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:46.059985 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8983ebfd-3638-496c-9be5-d8559f2d1eaf tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:46.060779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8983ebfd-3638-496c-9be5-d8559f2d1eaf tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:46.061214 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8983ebfd-3638-496c-9be5-d8559f2d1eaf tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:46.192292 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8983ebfd-3638-496c-9be5-d8559f2d1eaf tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:46.200189 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8983ebfd-3638-496c-9be5-d8559f2d1eaf tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1555 microversion: 2.1 time: 0.152250 Jun 16 21:18:46.200854 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 429/893] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:46 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:46.213412 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-dae04955-00b5-42f1-84f5-b581b1e156ad tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:46.214019 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-dae04955-00b5-42f1-84f5-b581b1e156ad tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:46.219853 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dae04955-00b5-42f1-84f5-b581b1e156ad tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:46.220325 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dae04955-00b5-42f1-84f5-b581b1e156ad tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:46.221075 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dae04955-00b5-42f1-84f5-b581b1e156ad tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:46.221527 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dae04955-00b5-42f1-84f5-b581b1e156ad tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:46.353373 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-dae04955-00b5-42f1-84f5-b581b1e156ad tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:46.360799 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-dae04955-00b5-42f1-84f5-b581b1e156ad tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1673 microversion: 2.1 time: 0.151163 Jun 16 21:18:46.361364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 465/894] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:46 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:47.067148 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2652b476-2073-4a75-bd22-ca4b711425d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:47.068026 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2652b476-2073-4a75-bd22-ca4b711425d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:47.075106 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2652b476-2073-4a75-bd22-ca4b711425d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:47.075638 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2652b476-2073-4a75-bd22-ca4b711425d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:47.076670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2652b476-2073-4a75-bd22-ca4b711425d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:47.077195 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2652b476-2073-4a75-bd22-ca4b711425d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:47.221329 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1427d301-0210-4e03-8e15-966d6d69ae08 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:47.223775 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1427d301-0210-4e03-8e15-966d6d69ae08 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:47.231094 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1427d301-0210-4e03-8e15-966d6d69ae08 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:47.232272 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1427d301-0210-4e03-8e15-966d6d69ae08 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:47.233701 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1427d301-0210-4e03-8e15-966d6d69ae08 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:47.234235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1427d301-0210-4e03-8e15-966d6d69ae08 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:47.325545 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2652b476-2073-4a75-bd22-ca4b711425d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:47.335632 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2652b476-2073-4a75-bd22-ca4b711425d1 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1367 microversion: 2.1 time: 0.273669 Jun 16 21:18:47.336894 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 430/895] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:47 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:47.380650 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-070743d4-9d83-48ec-89b7-a391bd70124e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:47.381528 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-070743d4-9d83-48ec-89b7-a391bd70124e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:47.384098 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1427d301-0210-4e03-8e15-966d6d69ae08 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:47.388270 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-070743d4-9d83-48ec-89b7-a391bd70124e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:47.389069 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-070743d4-9d83-48ec-89b7-a391bd70124e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:47.390251 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-070743d4-9d83-48ec-89b7-a391bd70124e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:47.391047 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-070743d4-9d83-48ec-89b7-a391bd70124e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:47.396528 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1427d301-0210-4e03-8e15-966d6d69ae08 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1513 microversion: 2.1 time: 0.182091 Jun 16 21:18:47.397114 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 466/896] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:47 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:18:47.492497 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-070743d4-9d83-48ec-89b7-a391bd70124e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:47.500556 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-070743d4-9d83-48ec-89b7-a391bd70124e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1605 microversion: 2.1 time: 0.125215 Jun 16 21:18:47.501137 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 431/897] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:47 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1605 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:47.965822 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-aa8bc9f6-063e-4354-8866-f152aec09145 req-463ca0d8-c15a-42c1-8293-ab6799253db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec1e2cd-9bb8-4602-9f96-77478cfc9af8", "name": "network-vif-deleted", "tag": "f26fce3f-5e61-4002-98b6-275c3b72e9db"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:47.975262 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-aa8bc9f6-063e-4354-8866-f152aec09145 req-463ca0d8-c15a-42c1-8293-ab6799253db8 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:47.975700 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-aa8bc9f6-063e-4354-8866-f152aec09145 req-463ca0d8-c15a-42c1-8293-ab6799253db8 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:47.986814 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-aa8bc9f6-063e-4354-8866-f152aec09145 req-463ca0d8-c15a-42c1-8293-ab6799253db8 service nova] Creating event network-vif-deleted:f26fce3f-5e61-4002-98b6-275c3b72e9db for instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 on hv-cinder-81914 Jun 16 21:18:47.993838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-aa8bc9f6-063e-4354-8866-f152aec09145 req-463ca0d8-c15a-42c1-8293-ab6799253db8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031606 Jun 16 21:18:47.994619 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 467/898] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:48.070721 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-e6a71ac1-52cf-422f-9aa7-9456afdc8d49 req-3d4992bc-a7ff-46fa-9908-c43b22542445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "499ae55d-60f9-480c-9ecd-794a1cee0da5", "name": "network-vif-deleted", "tag": "49dfc0a9-3807-4075-a9a7-5f2dceb98537"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:48.079460 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-e6a71ac1-52cf-422f-9aa7-9456afdc8d49 req-3d4992bc-a7ff-46fa-9908-c43b22542445 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:48.079896 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-e6a71ac1-52cf-422f-9aa7-9456afdc8d49 req-3d4992bc-a7ff-46fa-9908-c43b22542445 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:48.091962 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-e6a71ac1-52cf-422f-9aa7-9456afdc8d49 req-3d4992bc-a7ff-46fa-9908-c43b22542445 service nova] Creating event network-vif-deleted:49dfc0a9-3807-4075-a9a7-5f2dceb98537 for instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 on hv-cinder-81914 Jun 16 21:18:48.097043 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-e6a71ac1-52cf-422f-9aa7-9456afdc8d49 req-3d4992bc-a7ff-46fa-9908-c43b22542445 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090192 Jun 16 21:18:48.097636 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 432/899] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:48.354561 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f6bd25c8-0427-4964-a748-d0c46b5d8673 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:48.355224 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f6bd25c8-0427-4964-a748-d0c46b5d8673 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:48.363672 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f6bd25c8-0427-4964-a748-d0c46b5d8673 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:48.364748 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f6bd25c8-0427-4964-a748-d0c46b5d8673 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:48.365579 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f6bd25c8-0427-4964-a748-d0c46b5d8673 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:48.366025 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f6bd25c8-0427-4964-a748-d0c46b5d8673 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:48.416964 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d05bde12-ccb7-4e4d-bac7-262eb2abad7a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:48.417766 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d05bde12-ccb7-4e4d-bac7-262eb2abad7a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:48.424451 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d05bde12-ccb7-4e4d-bac7-262eb2abad7a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:48.425115 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d05bde12-ccb7-4e4d-bac7-262eb2abad7a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:48.426100 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d05bde12-ccb7-4e4d-bac7-262eb2abad7a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:48.426713 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d05bde12-ccb7-4e4d-bac7-262eb2abad7a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:48.463395 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d05bde12-ccb7-4e4d-bac7-262eb2abad7a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:48.464158 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d05bde12-ccb7-4e4d-bac7-262eb2abad7a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:48.465007 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.objects.instance [None req-d05bde12-ccb7-4e4d-bac7-262eb2abad7a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lazy-loading 'fault' on Instance uuid 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 {{(pid=117738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:18:48.517378 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d05bde12-ccb7-4e4d-bac7-262eb2abad7a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573eab511f4f41b78614247c0f4b99a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df862b955995466a84bc189d9098d7ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:48.526240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f6bd25c8-0427-4964-a748-d0c46b5d8673 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:48.527975 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d05bde12-ccb7-4e4d-bac7-262eb2abad7a tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 200 len: 1349 microversion: 2.1 time: 0.117209 Jun 16 21:18:48.528820 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 433/900] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:48 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 1349 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:48.534290 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-707e81cd-20ed-4988-90f1-750f94c28b92 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:48.535243 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-707e81cd-20ed-4988-90f1-750f94c28b92 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:48.537355 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f6bd25c8-0427-4964-a748-d0c46b5d8673 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1558 microversion: 2.1 time: 0.187481 Jun 16 21:18:48.542086 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-707e81cd-20ed-4988-90f1-750f94c28b92 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:48.542624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-707e81cd-20ed-4988-90f1-750f94c28b92 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:48.543515 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-707e81cd-20ed-4988-90f1-750f94c28b92 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:48.544025 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-707e81cd-20ed-4988-90f1-750f94c28b92 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:48.548748 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 468/901] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:48 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1558 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:48.557769 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-03a4b260-4ebe-4b19-864b-5bbe5f5bf398 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:48.558867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-03a4b260-4ebe-4b19-864b-5bbe5f5bf398 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:48.566216 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-03a4b260-4ebe-4b19-864b-5bbe5f5bf398 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:48.567516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-03a4b260-4ebe-4b19-864b-5bbe5f5bf398 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:48.568329 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-03a4b260-4ebe-4b19-864b-5bbe5f5bf398 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:48.568926 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-03a4b260-4ebe-4b19-864b-5bbe5f5bf398 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:48.625337 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-707e81cd-20ed-4988-90f1-750f94c28b92 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:48.635999 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-707e81cd-20ed-4988-90f1-750f94c28b92 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 200 len: 1322 microversion: 2.1 time: 0.104998 Jun 16 21:18:48.640405 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 434/902] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:48 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 1322 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:48.725614 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-03a4b260-4ebe-4b19-864b-5bbe5f5bf398 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.173069 Jun 16 21:18:48.728001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 469/903] 10.222.0.43 () {58 vars in 1274 bytes} [Thu Jun 16 21:18:48 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18/os-interface => generated 285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:18:49.547084 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-71f799ab-1b83-4a47-9f88-5ed2bf2dbc50 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:49.547811 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-71f799ab-1b83-4a47-9f88-5ed2bf2dbc50 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] [instance: 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:49.554655 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-71f799ab-1b83-4a47-9f88-5ed2bf2dbc50 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:49.555190 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-71f799ab-1b83-4a47-9f88-5ed2bf2dbc50 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:49.555971 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-71f799ab-1b83-4a47-9f88-5ed2bf2dbc50 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:49.556446 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-71f799ab-1b83-4a47-9f88-5ed2bf2dbc50 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:49.571613 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-71f799ab-1b83-4a47-9f88-5ed2bf2dbc50 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] HTTP exception thrown: Instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 could not be found. Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-71f799ab-1b83-4a47-9f88-5ed2bf2dbc50 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Request method failure captured: Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 HTTP/1.1 Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq51cHW2GbcoU2tA5l9J9PkoGADS-ZtBTNDY4Q1dEV4j2f95dQ2PCGjzgN_fGqklQ7D4wzuzMhkNJItXsd68jYgUOJJ6Rezqc3LdgTe1wMFqjFk9LWq0KPfbKsVF56dlyy3e6b3phpf-5lQIFWSFsOXXQDJRr4glhISzLhvuc_tzIek4 Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: df862b955995466a84bc189d9098d7ce Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-TestMinimumBasicScenario-1623586547 Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:18:49.573294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:18:49.574597 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/df862b955995466a84bc189d9098d7ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_df862b955995466a84bc189d9098d7ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/df862b955995466a84bc189d9098d7ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/df862b955995466a84bc189d9098d7ce"}]}] Jun 16 21:18:49.574597 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-TestMinimumBasicScenario-1623586547 Jun 16 21:18:49.574597 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: df862b955995466a84bc189d9098d7ce Jun 16 21:18:49.574597 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1623586547 Jun 16 21:18:49.574597 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-TestMinimumBasicScenario-1623586547-project Jun 16 21:18:49.574597 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:18:49.574597 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:18:49.574597 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 573eab511f4f41b78614247c0f4b99a1 Jun 16 21:18:49.574597 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-TestMinimumBasicScenario-1623586547-project Jun 16 21:18:49.574597 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:18:49.574597 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 could not be found. Jun 16 21:18:49.574597 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '4ec1e2cd-9bb8-4602-9f96-77478cfc9af8'} Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 could not be found. Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:18:49.575324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 could not be found. Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 could not be found. Jun 16 21:18:49.576616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:18:49.577791 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-71f799ab-1b83-4a47-9f88-5ed2bf2dbc50 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Returning 404 to user: Instance 4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:18:49.577791 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-71f799ab-1b83-4a47-9f88-5ed2bf2dbc50 tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8" status: 404 len: 111 microversion: 2.1 time: 0.031734 Jun 16 21:18:49.577791 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 435/904] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:49 2022] GET /compute/v2.1/servers/4ec1e2cd-9bb8-4602-9f96-77478cfc9af8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 21:18:49.584798 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-92acc401-9f67-4fcb-abb4-91c77816f35e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] Calling method '.version_select at 0x7fb3f765daf0>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:49.607216 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-92acc401-9f67-4fcb-abb4-91c77816f35e tempest-TestMinimumBasicScenario-1623586547 tempest-TestMinimumBasicScenario-1623586547-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1115147593" status: 202 len: 0 microversion: 2.1 time: 0.027462 Jun 16 21:18:49.608081 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 470/905] 10.222.0.43 () {58 vars in 1271 bytes} [Thu Jun 16 21:18:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1115147593 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:18:49.653018 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2b9632bc-2cb2-4e2f-b225-5b6db19c092d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:49.653774 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2b9632bc-2cb2-4e2f-b225-5b6db19c092d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:49.660439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2b9632bc-2cb2-4e2f-b225-5b6db19c092d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:49.660773 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2b9632bc-2cb2-4e2f-b225-5b6db19c092d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:49.661628 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2b9632bc-2cb2-4e2f-b225-5b6db19c092d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:49.661969 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2b9632bc-2cb2-4e2f-b225-5b6db19c092d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:49.676167 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-2b9632bc-2cb2-4e2f-b225-5b6db19c092d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] HTTP exception thrown: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2b9632bc-2cb2-4e2f-b225-5b6db19c092d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Request method failure captured: Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 HTTP/1.1 Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq5zsa35CtN8XEl75-3NrP_xD-Z7zHpuMyMzYg4Yxg3B_gzLMFcdAmxPm5DKcxX4gVGQP_eQs5f6ZenY30sXHg0t_LqrszxEv-diPFZcjk3dTV-3lU-D9-lJjSrjszv5Hb2y4cKp0JVmzUOvCBRqHC6SXIi044ZiYUoeMQ6oo3fWTG1o Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 536b36bd517a4dca8706718f6bab9c1a Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:18:49.677761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:18:49.679063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/536b36bd517a4dca8706718f6bab9c1a"}]}] Jun 16 21:18:49.679063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:18:49.679063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 536b36bd517a4dca8706718f6bab9c1a Jun 16 21:18:49.679063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:18:49.679063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-AttachVolumeTestJSON-1205751699-project Jun 16 21:18:49.679063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:18:49.679063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:18:49.679063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 9c13ce02fca548c5b1186a536a2d4474 Jun 16 21:18:49.679063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-AttachVolumeTestJSON-1205751699-project Jun 16 21:18:49.679063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:18:49.679063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. Jun 16 21:18:49.679063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '499ae55d-60f9-480c-9ecd-794a1cee0da5'} Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:18:49.679821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. Jun 16 21:18:49.681014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:18:49.682031 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2b9632bc-2cb2-4e2f-b225-5b6db19c092d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Returning 404 to user: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:18:49.682031 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2b9632bc-2cb2-4e2f-b225-5b6db19c092d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 404 len: 111 microversion: 2.1 time: 0.030135 Jun 16 21:18:49.682031 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 436/906] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:49 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:18:49.688165 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-aa270f3f-d7b5-4c2c-969c-619b7b012cd8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '.version_select at 0x7fb3f765f5e0>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:49.707125 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-aa270f3f-d7b5-4c2c-969c-619b7b012cd8 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322796889" status: 202 len: 0 microversion: 2.1 time: 0.022639 Jun 16 21:18:49.711424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 471/907] 10.222.0.43 () {58 vars in 1220 bytes} [Thu Jun 16 21:18:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322796889 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:18:50.113055 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-67b403d5-d54d-435b-a5b0-aad45ed421c0 req-439703d9-d177-468e-a8b8-56ba993289be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b46c41-400a-4a80-9bcf-d07fcfd34a18", "tag": "888667cf-09a8-4cc3-8749-acf758b60412"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:50.122075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-67b403d5-d54d-435b-a5b0-aad45ed421c0 req-439703d9-d177-468e-a8b8-56ba993289be service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:50.123003 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-67b403d5-d54d-435b-a5b0-aad45ed421c0 req-439703d9-d177-468e-a8b8-56ba993289be service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:50.137337 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-67b403d5-d54d-435b-a5b0-aad45ed421c0 req-439703d9-d177-468e-a8b8-56ba993289be service nova] Creating event network-changed:888667cf-09a8-4cc3-8749-acf758b60412 for instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 on hv-cinder-81914 Jun 16 21:18:50.143683 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-67b403d5-d54d-435b-a5b0-aad45ed421c0 req-439703d9-d177-468e-a8b8-56ba993289be service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034505 Jun 16 21:18:50.144636 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 437/908] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:50.468247 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-462989de-0217-4697-8a1d-97efa56449e6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Action: 'create', calling method: .version_select at 0x7fb3f77f0310>, body: {"keypair": {"name": "tempest-keypair-482291227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPkQaD8ktm3TbkzEMQrIa/+YTOkEx8OnFl6NZnCEmT2whzn+BQagZ7+iDGpueDK1rIhBWiUsaeLY6rV8edozE9HmwFAgw454SriaVeh211RLTJvjHynDzuswAhgcbM1zQ=="}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:50.487480 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-462989de-0217-4697-8a1d-97efa56449e6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Getting quotas for project 536b36bd517a4dca8706718f6bab9c1a. Resources: {'key_pairs'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:18:50.491670 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-462989de-0217-4697-8a1d-97efa56449e6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Getting quotas for user 9c13ce02fca548c5b1186a536a2d4474 and project 536b36bd517a4dca8706718f6bab9c1a. Resources: {'key_pairs'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:18:50.517606 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-462989de-0217-4697-8a1d-97efa56449e6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053190 Jun 16 21:18:50.518965 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 472/909] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 16 21:18:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:52.051428 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-70e6fb98-7053-4393-b0c2-6077ae5e2f5d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-79624662", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c45b6299-9716-4173-aacf-27f0517667e5"}], "security_groups": [{"name": "tempest-securitygroup--1148585208"}], "key_name": "tempest-keypair-482291227", "user_data": "}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:52.190287 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.network.neutron [None req-70e6fb98-7053-4393-b0c2-6077ae5e2f5d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] validate_networks() for [('c45b6299-9716-4173-aacf-27f0517667e5', None, None, None, None, None)] {{(pid=117738) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:18:52.734616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-70e6fb98-7053-4393-b0c2-6077ae5e2f5d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Flavor limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:18:52.735372 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-70e6fb98-7053-4393-b0c2-6077ae5e2f5d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Image limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:18:52.735372 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-70e6fb98-7053-4393-b0c2-6077ae5e2f5d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Flavor pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:18:52.735372 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-70e6fb98-7053-4393-b0c2-6077ae5e2f5d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Image pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:18:52.735372 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-70e6fb98-7053-4393-b0c2-6077ae5e2f5d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:18:52.748146 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-70e6fb98-7053-4393-b0c2-6077ae5e2f5d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:52.748846 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-70e6fb98-7053-4393-b0c2-6077ae5e2f5d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:52.749656 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-70e6fb98-7053-4393-b0c2-6077ae5e2f5d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:52.750100 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-70e6fb98-7053-4393-b0c2-6077ae5e2f5d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:52.767194 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-70e6fb98-7053-4393-b0c2-6077ae5e2f5d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Getting quotas for project 536b36bd517a4dca8706718f6bab9c1a. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:18:52.771949 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-70e6fb98-7053-4393-b0c2-6077ae5e2f5d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Getting quotas for user 9c13ce02fca548c5b1186a536a2d4474 and project 536b36bd517a4dca8706718f6bab9c1a. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:18:52.774402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:52.786171 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-70e6fb98-7053-4393-b0c2-6077ae5e2f5d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Going to run 1 instances... {{(pid=117738) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:18:52.788599 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-70e6fb98-7053-4393-b0c2-6077ae5e2f5d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:18:52.840988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-70e6fb98-7053-4393-b0c2-6077ae5e2f5d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.795213 Jun 16 21:18:52.842818 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 438/910] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:18:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:18:52.853878 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9800b29a-cfa4-48b0-b768-f771dbc43f7e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:52.855167 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-9800b29a-cfa4-48b0-b768-f771dbc43f7e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:52.955551 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9800b29a-cfa4-48b0-b768-f771dbc43f7e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:52.970211 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9800b29a-cfa4-48b0-b768-f771dbc43f7e tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 200 len: 1235 microversion: 2.1 time: 0.117385 Jun 16 21:18:52.971706 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 473/911] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:52 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 1235 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:53.989421 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c97c2881-bff9-48f4-9a5c-3f36495caa83 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:53.991715 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c97c2881-bff9-48f4-9a5c-3f36495caa83 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:54.000897 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c97c2881-bff9-48f4-9a5c-3f36495caa83 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:54.001548 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c97c2881-bff9-48f4-9a5c-3f36495caa83 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:54.002631 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c97c2881-bff9-48f4-9a5c-3f36495caa83 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:54.004568 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c97c2881-bff9-48f4-9a5c-3f36495caa83 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:54.107214 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c97c2881-bff9-48f4-9a5c-3f36495caa83 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:54.119677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c97c2881-bff9-48f4-9a5c-3f36495caa83 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 200 len: 1295 microversion: 2.1 time: 0.135585 Jun 16 21:18:54.122421 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 439/912] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:53 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 1295 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:55.137697 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-fe45d82b-6f6e-41c2-bd64-2eb4ff0e5dd0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:55.138476 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-fe45d82b-6f6e-41c2-bd64-2eb4ff0e5dd0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:55.145959 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fe45d82b-6f6e-41c2-bd64-2eb4ff0e5dd0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:55.146530 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fe45d82b-6f6e-41c2-bd64-2eb4ff0e5dd0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:55.147408 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fe45d82b-6f6e-41c2-bd64-2eb4ff0e5dd0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:55.148106 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-fe45d82b-6f6e-41c2-bd64-2eb4ff0e5dd0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:55.366439 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-fe45d82b-6f6e-41c2-bd64-2eb4ff0e5dd0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:55.374450 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-fe45d82b-6f6e-41c2-bd64-2eb4ff0e5dd0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 200 len: 1361 microversion: 2.1 time: 0.241677 Jun 16 21:18:55.375129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 474/913] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:55 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 1361 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:55.713128 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-6a7da7a3-2487-493d-8b9b-7f05f7c1a44b req-b9390415-4947-43c4-9088-daa1d196b0cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319ab15e-eeb3-4557-9840-4ebfd759e4b3", "tag": "dbf06214-e133-43af-b2fc-89ebd0b9c79b"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:55.746097 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-6a7da7a3-2487-493d-8b9b-7f05f7c1a44b req-b9390415-4947-43c4-9088-daa1d196b0cb service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:55.746604 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-6a7da7a3-2487-493d-8b9b-7f05f7c1a44b req-b9390415-4947-43c4-9088-daa1d196b0cb service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:55.763332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-6a7da7a3-2487-493d-8b9b-7f05f7c1a44b req-b9390415-4947-43c4-9088-daa1d196b0cb service nova] Creating event network-changed:dbf06214-e133-43af-b2fc-89ebd0b9c79b for instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 on hv-cinder-81914 Jun 16 21:18:55.770618 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-6a7da7a3-2487-493d-8b9b-7f05f7c1a44b req-b9390415-4947-43c4-9088-daa1d196b0cb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061102 Jun 16 21:18:55.771749 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 440/914] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:18:56.392201 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-245454e0-06cf-444f-955e-91446582ce89 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:56.394088 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-245454e0-06cf-444f-955e-91446582ce89 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:56.401368 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-245454e0-06cf-444f-955e-91446582ce89 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:56.402091 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-245454e0-06cf-444f-955e-91446582ce89 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:56.403047 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-245454e0-06cf-444f-955e-91446582ce89 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:56.403642 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-245454e0-06cf-444f-955e-91446582ce89 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:56.550433 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-245454e0-06cf-444f-955e-91446582ce89 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:56.558381 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-245454e0-06cf-444f-955e-91446582ce89 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 200 len: 1361 microversion: 2.1 time: 0.170189 Jun 16 21:18:56.559193 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 475/915] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:56 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:57.576902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3f099b96-d48f-469a-b093-c526ea02aef2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:57.577554 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-3f099b96-d48f-469a-b093-c526ea02aef2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:57.583884 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3f099b96-d48f-469a-b093-c526ea02aef2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:57.584383 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3f099b96-d48f-469a-b093-c526ea02aef2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:57.585162 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3f099b96-d48f-469a-b093-c526ea02aef2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:57.585598 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3f099b96-d48f-469a-b093-c526ea02aef2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:57.695210 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-355b50d9-91c1-43f2-9b89-e4bf7f3cfbf8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:57.696466 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-355b50d9-91c1-43f2-9b89-e4bf7f3cfbf8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:57.704903 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-355b50d9-91c1-43f2-9b89-e4bf7f3cfbf8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:57.705353 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-355b50d9-91c1-43f2-9b89-e4bf7f3cfbf8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:57.706959 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-355b50d9-91c1-43f2-9b89-e4bf7f3cfbf8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:57.707397 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-355b50d9-91c1-43f2-9b89-e4bf7f3cfbf8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:57.759309 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-355b50d9-91c1-43f2-9b89-e4bf7f3cfbf8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c/ips" status: 200 len: 151 microversion: 2.20 time: 0.068501 Jun 16 21:18:57.760643 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 476/916] 10.222.0.43 () {60 vars in 1288 bytes} [Thu Jun 16 21:18:57 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c/ips => generated 151 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:18:57.796939 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-3f099b96-d48f-469a-b093-c526ea02aef2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:57.806719 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-3f099b96-d48f-469a-b093-c526ea02aef2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 200 len: 1361 microversion: 2.1 time: 0.234551 Jun 16 21:18:57.807436 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 441/917] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:57 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:58.823561 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4ccf3193-d70b-4308-97ce-b28f52c2d66d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:18:58.824817 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4ccf3193-d70b-4308-97ce-b28f52c2d66d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:58.832448 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4ccf3193-d70b-4308-97ce-b28f52c2d66d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:58.832901 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4ccf3193-d70b-4308-97ce-b28f52c2d66d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:58.833839 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4ccf3193-d70b-4308-97ce-b28f52c2d66d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:58.834283 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4ccf3193-d70b-4308-97ce-b28f52c2d66d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:59.003225 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4ccf3193-d70b-4308-97ce-b28f52c2d66d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:18:59.010873 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4ccf3193-d70b-4308-97ce-b28f52c2d66d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 200 len: 1361 microversion: 2.1 time: 0.191104 Jun 16 21:18:59.011427 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 477/918] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:18:58 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:18:59.703319 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b42ab763-7351-4a09-bc89-c43e4aff812f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:18:59.703852 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b42ab763-7351-4a09-bc89-c43e4aff812f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:18:59.710859 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b42ab763-7351-4a09-bc89-c43e4aff812f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:59.711305 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b42ab763-7351-4a09-bc89-c43e4aff812f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:59.712068 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b42ab763-7351-4a09-bc89-c43e4aff812f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:18:59.712525 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b42ab763-7351-4a09-bc89-c43e4aff812f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:18:59.735372 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.objects.instance [None req-b42ab763-7351-4a09-bc89-c43e4aff812f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lazy-loading 'flavor' on Instance uuid 6a1b5610-fa96-44cf-b05b-41a354370d1c {{(pid=117738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:18:59.997386 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b42ab763-7351-4a09-bc89-c43e4aff812f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "POST /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c/action" status: 202 len: 0 microversion: 2.20 time: 0.297803 Jun 16 21:18:59.998074 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 442/919] 10.222.0.43 () {62 vars in 1318 bytes} [Thu Jun 16 21:18:59 2022] POST /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:19:00.006393 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5427fcb4-e91c-48b5-a630-5444f448d4bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:00.007560 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5427fcb4-e91c-48b5-a630-5444f448d4bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:00.014575 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5427fcb4-e91c-48b5-a630-5444f448d4bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:00.015024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5427fcb4-e91c-48b5-a630-5444f448d4bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:00.015827 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5427fcb4-e91c-48b5-a630-5444f448d4bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:00.016283 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5427fcb4-e91c-48b5-a630-5444f448d4bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:00.029752 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d8fa1fe2-6c75-43c8-b9f9-d62a244461ac tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:00.030923 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d8fa1fe2-6c75-43c8-b9f9-d62a244461ac tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:00.038225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d8fa1fe2-6c75-43c8-b9f9-d62a244461ac tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:00.038677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d8fa1fe2-6c75-43c8-b9f9-d62a244461ac tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:00.039467 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d8fa1fe2-6c75-43c8-b9f9-d62a244461ac tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:00.039917 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d8fa1fe2-6c75-43c8-b9f9-d62a244461ac tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:00.154388 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5427fcb4-e91c-48b5-a630-5444f448d4bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:00.163007 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5427fcb4-e91c-48b5-a630-5444f448d4bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:00.164546 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5427fcb4-e91c-48b5-a630-5444f448d4bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:00.165840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5427fcb4-e91c-48b5-a630-5444f448d4bb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.163570 Jun 16 21:19:00.166405 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 478/920] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:00 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:00.178138 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d8fa1fe2-6c75-43c8-b9f9-d62a244461ac tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:00.185505 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d8fa1fe2-6c75-43c8-b9f9-d62a244461ac tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 200 len: 1361 microversion: 2.1 time: 0.161008 Jun 16 21:19:00.186064 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 443/921] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:00 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:19:01.184476 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-852d6863-f59f-4c9b-903a-aaae698971df tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:01.185090 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-852d6863-f59f-4c9b-903a-aaae698971df tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:01.192456 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-852d6863-f59f-4c9b-903a-aaae698971df tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:01.192959 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-852d6863-f59f-4c9b-903a-aaae698971df tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:01.193842 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-852d6863-f59f-4c9b-903a-aaae698971df tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:01.194322 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-852d6863-f59f-4c9b-903a-aaae698971df tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:01.204629 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6c707058-41dc-442b-84b1-86585bf5648f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:01.205919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6c707058-41dc-442b-84b1-86585bf5648f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:01.216245 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6c707058-41dc-442b-84b1-86585bf5648f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:01.216971 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6c707058-41dc-442b-84b1-86585bf5648f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:01.218215 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6c707058-41dc-442b-84b1-86585bf5648f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:01.218863 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6c707058-41dc-442b-84b1-86585bf5648f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:01.225609 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:01.365550 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-852d6863-f59f-4c9b-903a-aaae698971df tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:01.375470 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-852d6863-f59f-4c9b-903a-aaae698971df tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:01.377119 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-852d6863-f59f-4c9b-903a-aaae698971df tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:01.378437 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-852d6863-f59f-4c9b-903a-aaae698971df tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.198071 Jun 16 21:19:01.379003 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6c707058-41dc-442b-84b1-86585bf5648f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:01.379330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 479/922] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:01 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:01.397581 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6c707058-41dc-442b-84b1-86585bf5648f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 200 len: 1361 microversion: 2.1 time: 0.199147 Jun 16 21:19:01.398148 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 444/923] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:01 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:01.637395 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-b8ee91b8-273b-49bd-b85b-90365c2cb6a4 req-cc239868-248c-4470-9f4c-4f83d1f8ad52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319ab15e-eeb3-4557-9840-4ebfd759e4b3", "name": "network-vif-plugged", "status": "completed", "tag": "dbf06214-e133-43af-b2fc-89ebd0b9c79b"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:19:01.645817 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-b8ee91b8-273b-49bd-b85b-90365c2cb6a4 req-cc239868-248c-4470-9f4c-4f83d1f8ad52 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:01.646245 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-b8ee91b8-273b-49bd-b85b-90365c2cb6a4 req-cc239868-248c-4470-9f4c-4f83d1f8ad52 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:01.656985 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-b8ee91b8-273b-49bd-b85b-90365c2cb6a4 req-cc239868-248c-4470-9f4c-4f83d1f8ad52 service nova] Creating event network-vif-plugged:dbf06214-e133-43af-b2fc-89ebd0b9c79b for instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 on hv-cinder-81914 Jun 16 21:19:01.662437 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-b8ee91b8-273b-49bd-b85b-90365c2cb6a4 req-cc239868-248c-4470-9f4c-4f83d1f8ad52 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219670 Jun 16 21:19:01.663000 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 480/924] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:19:02.397165 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5fb95f56-676c-4cf5-ad01-62418be91d4f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:02.397770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5fb95f56-676c-4cf5-ad01-62418be91d4f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:02.404234 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5fb95f56-676c-4cf5-ad01-62418be91d4f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:02.404682 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5fb95f56-676c-4cf5-ad01-62418be91d4f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:02.405437 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5fb95f56-676c-4cf5-ad01-62418be91d4f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:02.405864 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5fb95f56-676c-4cf5-ad01-62418be91d4f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:02.416860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-cbd8e762-f473-472f-8b36-64f9216888cc tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:02.417866 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-cbd8e762-f473-472f-8b36-64f9216888cc tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:02.426365 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cbd8e762-f473-472f-8b36-64f9216888cc tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:02.426815 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cbd8e762-f473-472f-8b36-64f9216888cc tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:02.427586 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cbd8e762-f473-472f-8b36-64f9216888cc tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:02.428023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cbd8e762-f473-472f-8b36-64f9216888cc tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:02.540529 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5fb95f56-676c-4cf5-ad01-62418be91d4f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:02.548560 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5fb95f56-676c-4cf5-ad01-62418be91d4f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:02.550796 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5fb95f56-676c-4cf5-ad01-62418be91d4f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:02.551965 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5fb95f56-676c-4cf5-ad01-62418be91d4f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.159272 Jun 16 21:19:02.552706 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 445/925] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:02 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:02.561289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-cbd8e762-f473-472f-8b36-64f9216888cc tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:02.568890 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-cbd8e762-f473-472f-8b36-64f9216888cc tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 200 len: 1361 microversion: 2.1 time: 0.157465 Jun 16 21:19:02.569441 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 481/926] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:02 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:19:03.570849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c58a52a2-bd38-4dfd-8fc4-9a0551009aae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:03.571484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c58a52a2-bd38-4dfd-8fc4-9a0551009aae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:03.573471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=2 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:03.574338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=6 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:03.580739 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c58a52a2-bd38-4dfd-8fc4-9a0551009aae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:03.580739 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c58a52a2-bd38-4dfd-8fc4-9a0551009aae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:03.581039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c58a52a2-bd38-4dfd-8fc4-9a0551009aae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:03.582230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c58a52a2-bd38-4dfd-8fc4-9a0551009aae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:03.586793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-56bc5f7a-2270-42d6-98ef-e8a615d59a1a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:03.587413 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-56bc5f7a-2270-42d6-98ef-e8a615d59a1a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:03.589465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=6 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:03.591191 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:03.597907 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-56bc5f7a-2270-42d6-98ef-e8a615d59a1a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:03.598364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-56bc5f7a-2270-42d6-98ef-e8a615d59a1a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:03.599137 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-56bc5f7a-2270-42d6-98ef-e8a615d59a1a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:03.599575 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-56bc5f7a-2270-42d6-98ef-e8a615d59a1a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:03.601965 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:03.725445 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c58a52a2-bd38-4dfd-8fc4-9a0551009aae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:03.733410 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c58a52a2-bd38-4dfd-8fc4-9a0551009aae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:03.734103 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-56bc5f7a-2270-42d6-98ef-e8a615d59a1a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:03.734924 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c58a52a2-bd38-4dfd-8fc4-9a0551009aae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:03.736095 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c58a52a2-bd38-4dfd-8fc4-9a0551009aae tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.169177 Jun 16 21:19:03.736701 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 446/927] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:03 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:03.742419 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-56bc5f7a-2270-42d6-98ef-e8a615d59a1a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 200 len: 1547 microversion: 2.1 time: 0.159932 Jun 16 21:19:03.743383 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 482/928] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:03 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:19:03.759961 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8e94f009-5a6c-4fac-9276-729a08f6eea9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:03.760487 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8e94f009-5a6c-4fac-9276-729a08f6eea9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:03.766449 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8e94f009-5a6c-4fac-9276-729a08f6eea9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:03.766897 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8e94f009-5a6c-4fac-9276-729a08f6eea9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:03.767663 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8e94f009-5a6c-4fac-9276-729a08f6eea9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:03.768726 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8e94f009-5a6c-4fac-9276-729a08f6eea9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:03.845127 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8e94f009-5a6c-4fac-9276-729a08f6eea9 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088918 Jun 16 21:19:03.845721 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 447/929] 10.222.0.43 () {58 vars in 1274 bytes} [Thu Jun 16 21:19:03 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:19:04.755492 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-81850d38-d092-48a0-834d-7e5c8095e7b9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:04.757081 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-81850d38-d092-48a0-834d-7e5c8095e7b9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:04.763933 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-81850d38-d092-48a0-834d-7e5c8095e7b9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:04.764496 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-81850d38-d092-48a0-834d-7e5c8095e7b9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:04.765333 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-81850d38-d092-48a0-834d-7e5c8095e7b9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:04.765825 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-81850d38-d092-48a0-834d-7e5c8095e7b9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:04.766390 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-bfaab5ee-b181-4d0c-b518-6f4acf6566c5 req-cb77b1bf-faf9-4e61-9537-11efd72eb889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319ab15e-eeb3-4557-9840-4ebfd759e4b3", "tag": "dbf06214-e133-43af-b2fc-89ebd0b9c79b"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:19:04.774623 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-bfaab5ee-b181-4d0c-b518-6f4acf6566c5 req-cb77b1bf-faf9-4e61-9537-11efd72eb889 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:04.775051 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-bfaab5ee-b181-4d0c-b518-6f4acf6566c5 req-cb77b1bf-faf9-4e61-9537-11efd72eb889 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:04.786806 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-bfaab5ee-b181-4d0c-b518-6f4acf6566c5 req-cb77b1bf-faf9-4e61-9537-11efd72eb889 service nova] Creating event network-changed:dbf06214-e133-43af-b2fc-89ebd0b9c79b for instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 on hv-cinder-81914 Jun 16 21:19:04.791974 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-bfaab5ee-b181-4d0c-b518-6f4acf6566c5 req-cb77b1bf-faf9-4e61-9537-11efd72eb889 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029566 Jun 16 21:19:04.792776 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 448/930] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:19:04.904828 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-81850d38-d092-48a0-834d-7e5c8095e7b9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:04.913494 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-81850d38-d092-48a0-834d-7e5c8095e7b9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:04.915041 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-81850d38-d092-48a0-834d-7e5c8095e7b9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:04.916239 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-81850d38-d092-48a0-834d-7e5c8095e7b9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.165212 Jun 16 21:19:04.916802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 483/931] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:04 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:05.935678 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-56291970-b265-4be1-b313-cbea550c3368 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:05.936408 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-56291970-b265-4be1-b313-cbea550c3368 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:05.943313 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-56291970-b265-4be1-b313-cbea550c3368 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:05.943755 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-56291970-b265-4be1-b313-cbea550c3368 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:05.944546 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-56291970-b265-4be1-b313-cbea550c3368 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:05.944981 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-56291970-b265-4be1-b313-cbea550c3368 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:06.071978 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-56291970-b265-4be1-b313-cbea550c3368 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:06.079891 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-56291970-b265-4be1-b313-cbea550c3368 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:06.081738 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-56291970-b265-4be1-b313-cbea550c3368 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:06.082902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-56291970-b265-4be1-b313-cbea550c3368 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.152064 Jun 16 21:19:06.083460 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 449/932] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:05 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:07.100602 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d5a0ef74-f25f-418a-9e85-b13c1b181a6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:07.101214 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d5a0ef74-f25f-418a-9e85-b13c1b181a6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:07.107787 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d5a0ef74-f25f-418a-9e85-b13c1b181a6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:07.108261 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d5a0ef74-f25f-418a-9e85-b13c1b181a6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:07.109020 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d5a0ef74-f25f-418a-9e85-b13c1b181a6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:07.109452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d5a0ef74-f25f-418a-9e85-b13c1b181a6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:07.253097 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d5a0ef74-f25f-418a-9e85-b13c1b181a6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:07.260956 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d5a0ef74-f25f-418a-9e85-b13c1b181a6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:07.262441 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d5a0ef74-f25f-418a-9e85-b13c1b181a6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:07.263620 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d5a0ef74-f25f-418a-9e85-b13c1b181a6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.167210 Jun 16 21:19:07.264188 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 484/933] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:07 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:08.283097 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-195f8e86-97f0-4327-aacc-9e47156b6648 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:08.283727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-195f8e86-97f0-4327-aacc-9e47156b6648 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:08.290226 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-195f8e86-97f0-4327-aacc-9e47156b6648 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:08.290671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-195f8e86-97f0-4327-aacc-9e47156b6648 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:08.291420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-195f8e86-97f0-4327-aacc-9e47156b6648 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:08.291848 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-195f8e86-97f0-4327-aacc-9e47156b6648 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:08.423804 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-195f8e86-97f0-4327-aacc-9e47156b6648 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:08.432882 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-195f8e86-97f0-4327-aacc-9e47156b6648 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:08.434415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-195f8e86-97f0-4327-aacc-9e47156b6648 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:08.435574 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-195f8e86-97f0-4327-aacc-9e47156b6648 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.156365 Jun 16 21:19:08.436152 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 450/934] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:08 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:09.454325 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a0d7d7a6-4cf2-45bc-93cd-8cc3f21b6181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:09.454876 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a0d7d7a6-4cf2-45bc-93cd-8cc3f21b6181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:09.461492 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a0d7d7a6-4cf2-45bc-93cd-8cc3f21b6181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:09.461938 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a0d7d7a6-4cf2-45bc-93cd-8cc3f21b6181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:09.462701 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a0d7d7a6-4cf2-45bc-93cd-8cc3f21b6181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:09.463134 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a0d7d7a6-4cf2-45bc-93cd-8cc3f21b6181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:09.596826 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a0d7d7a6-4cf2-45bc-93cd-8cc3f21b6181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:09.604795 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a0d7d7a6-4cf2-45bc-93cd-8cc3f21b6181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:09.606312 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-a0d7d7a6-4cf2-45bc-93cd-8cc3f21b6181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:09.607466 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a0d7d7a6-4cf2-45bc-93cd-8cc3f21b6181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.157199 Jun 16 21:19:09.608010 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 485/935] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:09 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:10.626867 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5ff62b85-ff01-421b-908b-4ba4f154b066 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:10.628612 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5ff62b85-ff01-421b-908b-4ba4f154b066 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:10.634811 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5ff62b85-ff01-421b-908b-4ba4f154b066 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:10.635286 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5ff62b85-ff01-421b-908b-4ba4f154b066 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:10.636041 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5ff62b85-ff01-421b-908b-4ba4f154b066 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:10.636504 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5ff62b85-ff01-421b-908b-4ba4f154b066 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:10.769767 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5ff62b85-ff01-421b-908b-4ba4f154b066 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:10.777661 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5ff62b85-ff01-421b-908b-4ba4f154b066 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:10.779150 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5ff62b85-ff01-421b-908b-4ba4f154b066 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:10.780339 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5ff62b85-ff01-421b-908b-4ba4f154b066 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.157369 Jun 16 21:19:10.780897 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 451/936] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:10 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:11.798886 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-bea8c1be-4dd5-4fb1-a04d-d5e04ac88219 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:11.799503 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-bea8c1be-4dd5-4fb1-a04d-d5e04ac88219 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:11.806557 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bea8c1be-4dd5-4fb1-a04d-d5e04ac88219 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:11.807006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bea8c1be-4dd5-4fb1-a04d-d5e04ac88219 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:11.807774 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bea8c1be-4dd5-4fb1-a04d-d5e04ac88219 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:11.808301 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bea8c1be-4dd5-4fb1-a04d-d5e04ac88219 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:11.935898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bea8c1be-4dd5-4fb1-a04d-d5e04ac88219 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:11.944597 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bea8c1be-4dd5-4fb1-a04d-d5e04ac88219 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:11.946099 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bea8c1be-4dd5-4fb1-a04d-d5e04ac88219 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:11.947300 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-bea8c1be-4dd5-4fb1-a04d-d5e04ac88219 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.152326 Jun 16 21:19:11.947853 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 486/937] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:11 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:12.964941 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-04710b78-f4bf-4e97-bd98-01216f06b9fe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:12.965464 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-04710b78-f4bf-4e97-bd98-01216f06b9fe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:12.971962 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04710b78-f4bf-4e97-bd98-01216f06b9fe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:12.973113 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04710b78-f4bf-4e97-bd98-01216f06b9fe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:12.973905 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04710b78-f4bf-4e97-bd98-01216f06b9fe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:12.974339 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04710b78-f4bf-4e97-bd98-01216f06b9fe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:13.105105 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-04710b78-f4bf-4e97-bd98-01216f06b9fe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:13.113607 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-04710b78-f4bf-4e97-bd98-01216f06b9fe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:13.115253 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-04710b78-f4bf-4e97-bd98-01216f06b9fe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:13.116442 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-04710b78-f4bf-4e97-bd98-01216f06b9fe tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.155498 Jun 16 21:19:13.116997 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 452/938] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:12 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:14.134921 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9fa26252-c53b-4c48-90e4-2c6656f36aa3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:14.135533 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-9fa26252-c53b-4c48-90e4-2c6656f36aa3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:14.142166 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9fa26252-c53b-4c48-90e4-2c6656f36aa3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:14.142611 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9fa26252-c53b-4c48-90e4-2c6656f36aa3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:14.143373 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9fa26252-c53b-4c48-90e4-2c6656f36aa3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:14.143808 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9fa26252-c53b-4c48-90e4-2c6656f36aa3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:14.274398 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9fa26252-c53b-4c48-90e4-2c6656f36aa3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:14.282232 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9fa26252-c53b-4c48-90e4-2c6656f36aa3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:14.283726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9fa26252-c53b-4c48-90e4-2c6656f36aa3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:14.285989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9fa26252-c53b-4c48-90e4-2c6656f36aa3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.153935 Jun 16 21:19:14.286545 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 487/939] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:14 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:15.304339 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-686c578f-372d-404b-9aed-1ff95ccd07eb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:15.304943 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-686c578f-372d-404b-9aed-1ff95ccd07eb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:15.311582 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-686c578f-372d-404b-9aed-1ff95ccd07eb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:15.312021 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-686c578f-372d-404b-9aed-1ff95ccd07eb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:15.312802 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-686c578f-372d-404b-9aed-1ff95ccd07eb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:15.313230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-686c578f-372d-404b-9aed-1ff95ccd07eb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:15.448050 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-686c578f-372d-404b-9aed-1ff95ccd07eb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:15.455944 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-686c578f-372d-404b-9aed-1ff95ccd07eb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:15.458064 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-686c578f-372d-404b-9aed-1ff95ccd07eb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:15.459222 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-686c578f-372d-404b-9aed-1ff95ccd07eb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.159521 Jun 16 21:19:15.459775 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 453/940] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:15 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:16.476589 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-056cf2a5-4694-46dc-847d-e12d3484d083 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:16.477226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-056cf2a5-4694-46dc-847d-e12d3484d083 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:16.483583 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-056cf2a5-4694-46dc-847d-e12d3484d083 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:16.484022 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-056cf2a5-4694-46dc-847d-e12d3484d083 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:16.484799 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-056cf2a5-4694-46dc-847d-e12d3484d083 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:16.485227 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-056cf2a5-4694-46dc-847d-e12d3484d083 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:16.622059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-056cf2a5-4694-46dc-847d-e12d3484d083 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:16.630657 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-056cf2a5-4694-46dc-847d-e12d3484d083 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:16.632191 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-056cf2a5-4694-46dc-847d-e12d3484d083 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:16.633349 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-056cf2a5-4694-46dc-847d-e12d3484d083 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1743 microversion: 2.20 time: 0.160641 Jun 16 21:19:16.633895 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 488/941] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:16 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:17.651207 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-fdb48f71-3f43-4d0b-8fc2-d96db9aedf1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:17.651820 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-fdb48f71-3f43-4d0b-8fc2-d96db9aedf1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:17.658395 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-fdb48f71-3f43-4d0b-8fc2-d96db9aedf1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:17.658839 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-fdb48f71-3f43-4d0b-8fc2-d96db9aedf1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:17.660148 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-fdb48f71-3f43-4d0b-8fc2-d96db9aedf1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:17.661070 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-fdb48f71-3f43-4d0b-8fc2-d96db9aedf1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:17.792682 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-fdb48f71-3f43-4d0b-8fc2-d96db9aedf1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:17.801223 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-fdb48f71-3f43-4d0b-8fc2-d96db9aedf1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:17.802739 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-fdb48f71-3f43-4d0b-8fc2-d96db9aedf1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:17.803907 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-fdb48f71-3f43-4d0b-8fc2-d96db9aedf1f tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1743 microversion: 2.20 time: 0.156601 Jun 16 21:19:17.804501 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 454/942] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:17 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:18.823626 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c499180d-3581-4224-a696-352f957e5ecb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:18.824168 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c499180d-3581-4224-a696-352f957e5ecb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:18.830752 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c499180d-3581-4224-a696-352f957e5ecb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:18.831220 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c499180d-3581-4224-a696-352f957e5ecb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:18.832156 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c499180d-3581-4224-a696-352f957e5ecb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:18.832800 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c499180d-3581-4224-a696-352f957e5ecb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:18.975263 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c499180d-3581-4224-a696-352f957e5ecb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:18.983250 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c499180d-3581-4224-a696-352f957e5ecb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:18.984800 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c499180d-3581-4224-a696-352f957e5ecb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:18.990650 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c499180d-3581-4224-a696-352f957e5ecb tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1738 microversion: 2.20 time: 0.171169 Jun 16 21:19:18.992009 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 489/943] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:18 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:19.560046 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-d19dfa43-2593-49de-8560-015094fc85a8 req-778d4932-f838-42b6-ae19-10f7fe2ecd75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1b5610-fa96-44cf-b05b-41a354370d1c", "name": "network-vif-plugged", "status": "completed", "tag": "ce808840-2e04-4b62-89bc-caeba961a739"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:19:19.575997 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-d19dfa43-2593-49de-8560-015094fc85a8 req-778d4932-f838-42b6-ae19-10f7fe2ecd75 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:19.576760 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-d19dfa43-2593-49de-8560-015094fc85a8 req-778d4932-f838-42b6-ae19-10f7fe2ecd75 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:19.590053 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-d19dfa43-2593-49de-8560-015094fc85a8 req-778d4932-f838-42b6-ae19-10f7fe2ecd75 service nova] Creating event network-vif-plugged:ce808840-2e04-4b62-89bc-caeba961a739 for instance 6a1b5610-fa96-44cf-b05b-41a354370d1c on hv-cinder-81914 Jun 16 21:19:19.596545 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-d19dfa43-2593-49de-8560-015094fc85a8 req-778d4932-f838-42b6-ae19-10f7fe2ecd75 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040324 Jun 16 21:19:19.597612 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 455/944] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:19:20.009528 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-04b8891e-3e60-4d80-9086-dd48d3494d7c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:20.010844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-04b8891e-3e60-4d80-9086-dd48d3494d7c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:20.017906 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-04b8891e-3e60-4d80-9086-dd48d3494d7c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:20.018649 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-04b8891e-3e60-4d80-9086-dd48d3494d7c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:20.020418 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-04b8891e-3e60-4d80-9086-dd48d3494d7c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:20.021001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-04b8891e-3e60-4d80-9086-dd48d3494d7c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:20.170917 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-04b8891e-3e60-4d80-9086-dd48d3494d7c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:20.180737 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-04b8891e-3e60-4d80-9086-dd48d3494d7c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:20.182238 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-04b8891e-3e60-4d80-9086-dd48d3494d7c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:20.183604 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-04b8891e-3e60-4d80-9086-dd48d3494d7c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1738 microversion: 2.20 time: 0.178012 Jun 16 21:19:20.184373 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 490/945] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:20 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:21.204544 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d427e0ab-f8e0-4da3-964c-87806ec400cc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:21.205249 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d427e0ab-f8e0-4da3-964c-87806ec400cc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:21.211694 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d427e0ab-f8e0-4da3-964c-87806ec400cc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:21.212139 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d427e0ab-f8e0-4da3-964c-87806ec400cc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:21.212940 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d427e0ab-f8e0-4da3-964c-87806ec400cc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:21.213372 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d427e0ab-f8e0-4da3-964c-87806ec400cc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:21.370478 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d427e0ab-f8e0-4da3-964c-87806ec400cc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:21.386480 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d427e0ab-f8e0-4da3-964c-87806ec400cc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:21.388347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d427e0ab-f8e0-4da3-964c-87806ec400cc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:21.389901 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d427e0ab-f8e0-4da3-964c-87806ec400cc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1738 microversion: 2.20 time: 0.190898 Jun 16 21:19:21.390626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 456/946] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:21 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:21.759012 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-442c75cb-1efd-4182-9503-aa5b80d69db9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:21.759590 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-442c75cb-1efd-4182-9503-aa5b80d69db9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:21.766261 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-442c75cb-1efd-4182-9503-aa5b80d69db9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:21.766986 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-442c75cb-1efd-4182-9503-aa5b80d69db9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:21.767953 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-442c75cb-1efd-4182-9503-aa5b80d69db9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:21.768421 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-442c75cb-1efd-4182-9503-aa5b80d69db9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:21.864322 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.objects.instance [None req-442c75cb-1efd-4182-9503-aa5b80d69db9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lazy-loading 'services' on Instance uuid 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 {{(pid=117737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:19:21.951302 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-442c75cb-1efd-4182-9503-aa5b80d69db9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "DELETE /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/os-volume_attachments/27c4460e-f225-4d5b-bb8d-c91ea0b2f456" status: 202 len: 0 microversion: 2.1 time: 0.196036 Jun 16 21:19:21.952317 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 491/947] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 16 21:19:21 2022] DELETE /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/os-volume_attachments/27c4460e-f225-4d5b-bb8d-c91ea0b2f456 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:19:21.974227 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7172cad2-00e1-4c57-9180-16a09db918a5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:21.975193 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7172cad2-00e1-4c57-9180-16a09db918a5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:21.981544 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7172cad2-00e1-4c57-9180-16a09db918a5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:21.981994 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7172cad2-00e1-4c57-9180-16a09db918a5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:21.982829 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7172cad2-00e1-4c57-9180-16a09db918a5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:21.983286 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7172cad2-00e1-4c57-9180-16a09db918a5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:22.036429 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7172cad2-00e1-4c57-9180-16a09db918a5 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079472 Jun 16 21:19:22.037465 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 457/948] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:19:21 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:19:22.409302 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5f8b3333-7790-49ce-8b73-054711c5e397 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:22.410567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5f8b3333-7790-49ce-8b73-054711c5e397 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:22.417659 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5f8b3333-7790-49ce-8b73-054711c5e397 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:22.418114 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5f8b3333-7790-49ce-8b73-054711c5e397 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:22.419048 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5f8b3333-7790-49ce-8b73-054711c5e397 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:22.419489 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5f8b3333-7790-49ce-8b73-054711c5e397 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:22.564395 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5f8b3333-7790-49ce-8b73-054711c5e397 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:22.581429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5f8b3333-7790-49ce-8b73-054711c5e397 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:22.583408 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5f8b3333-7790-49ce-8b73-054711c5e397 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:22.584640 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5f8b3333-7790-49ce-8b73-054711c5e397 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1738 microversion: 2.20 time: 0.179794 Jun 16 21:19:22.585368 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 492/949] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:22 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:23.050192 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-ae51c1da-985f-428e-881a-6241088f829c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:23.051782 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-ae51c1da-985f-428e-881a-6241088f829c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:23.055491 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:23.059518 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ae51c1da-985f-428e-881a-6241088f829c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:23.059970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ae51c1da-985f-428e-881a-6241088f829c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:23.060778 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ae51c1da-985f-428e-881a-6241088f829c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:23.061214 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ae51c1da-985f-428e-881a-6241088f829c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:23.100630 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-ae51c1da-985f-428e-881a-6241088f829c tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054852 Jun 16 21:19:23.101436 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 458/950] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:19:23 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 21:19:23.181682 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e1bdb044-7efe-431c-ab3e-742a57618108 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:23.182861 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e1bdb044-7efe-431c-ab3e-742a57618108 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:23.191338 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e1bdb044-7efe-431c-ab3e-742a57618108 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:23.192321 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e1bdb044-7efe-431c-ab3e-742a57618108 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:23.194355 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e1bdb044-7efe-431c-ab3e-742a57618108 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:23.195150 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e1bdb044-7efe-431c-ab3e-742a57618108 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:23.225318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e1bdb044-7efe-431c-ab3e-742a57618108 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Going to try to terminate instance {{(pid=117737) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:19:23.311721 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e1bdb044-7efe-431c-ab3e-742a57618108 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "DELETE /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 204 len: 0 microversion: 2.1 time: 0.134353 Jun 16 21:19:23.312776 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 493/951] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:19:23 2022] DELETE /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:19:23.324630 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-254ff5e0-82c5-4076-94c7-9503c64ec7e2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:23.327260 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-254ff5e0-82c5-4076-94c7-9503c64ec7e2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:23.338576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-254ff5e0-82c5-4076-94c7-9503c64ec7e2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:23.339130 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-254ff5e0-82c5-4076-94c7-9503c64ec7e2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:23.339826 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-254ff5e0-82c5-4076-94c7-9503c64ec7e2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:23.340370 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-254ff5e0-82c5-4076-94c7-9503c64ec7e2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:23.483731 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-254ff5e0-82c5-4076-94c7-9503c64ec7e2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:23.494824 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-254ff5e0-82c5-4076-94c7-9503c64ec7e2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1691 microversion: 2.1 time: 0.177367 Jun 16 21:19:23.496045 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 459/952] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:23 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:23.604524 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-02027352-f9a3-41cb-8bbf-79e9f525f8ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:23.606137 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-02027352-f9a3-41cb-8bbf-79e9f525f8ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:23.614630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-02027352-f9a3-41cb-8bbf-79e9f525f8ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:23.615124 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-02027352-f9a3-41cb-8bbf-79e9f525f8ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:23.615901 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-02027352-f9a3-41cb-8bbf-79e9f525f8ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:23.616441 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-02027352-f9a3-41cb-8bbf-79e9f525f8ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:23.637580 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:23.773309 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-02027352-f9a3-41cb-8bbf-79e9f525f8ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:23.781829 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-02027352-f9a3-41cb-8bbf-79e9f525f8ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:23.783334 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-02027352-f9a3-41cb-8bbf-79e9f525f8ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:23.784571 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-02027352-f9a3-41cb-8bbf-79e9f525f8ab tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1738 microversion: 2.20 time: 0.184267 Jun 16 21:19:23.785957 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 494/953] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:23 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:24.511550 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7b4658e6-f6b8-480e-8a76-55a187f04fe3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:24.512163 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7b4658e6-f6b8-480e-8a76-55a187f04fe3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:24.520456 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7b4658e6-f6b8-480e-8a76-55a187f04fe3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:24.521151 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7b4658e6-f6b8-480e-8a76-55a187f04fe3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:24.526777 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7b4658e6-f6b8-480e-8a76-55a187f04fe3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:24.527548 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7b4658e6-f6b8-480e-8a76-55a187f04fe3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:24.684902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-7b4658e6-f6b8-480e-8a76-55a187f04fe3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:24.693126 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7b4658e6-f6b8-480e-8a76-55a187f04fe3 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1691 microversion: 2.1 time: 0.185519 Jun 16 21:19:24.702869 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 460/954] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:24 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1691 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:24.803466 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-2526d0d0-1d76-4355-a1e1-2f480e69c3d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:24.804727 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-2526d0d0-1d76-4355-a1e1-2f480e69c3d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:24.811313 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2526d0d0-1d76-4355-a1e1-2f480e69c3d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:24.811824 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2526d0d0-1d76-4355-a1e1-2f480e69c3d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:24.813001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2526d0d0-1d76-4355-a1e1-2f480e69c3d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:24.814275 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2526d0d0-1d76-4355-a1e1-2f480e69c3d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:24.967258 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2526d0d0-1d76-4355-a1e1-2f480e69c3d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:24.978374 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2526d0d0-1d76-4355-a1e1-2f480e69c3d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:24.979865 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2526d0d0-1d76-4355-a1e1-2f480e69c3d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:24.981079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-2526d0d0-1d76-4355-a1e1-2f480e69c3d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1738 microversion: 2.20 time: 0.182188 Jun 16 21:19:24.981629 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 495/955] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:24 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:25.711008 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2e55d136-7270-4aa0-b646-edb1fe3f1ad9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:25.711956 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2e55d136-7270-4aa0-b646-edb1fe3f1ad9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:25.718748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e55d136-7270-4aa0-b646-edb1fe3f1ad9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:25.719663 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e55d136-7270-4aa0-b646-edb1fe3f1ad9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:25.720651 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e55d136-7270-4aa0-b646-edb1fe3f1ad9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:25.720961 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e55d136-7270-4aa0-b646-edb1fe3f1ad9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:25.875301 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2e55d136-7270-4aa0-b646-edb1fe3f1ad9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:25.888777 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2e55d136-7270-4aa0-b646-edb1fe3f1ad9 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1691 microversion: 2.1 time: 0.182368 Jun 16 21:19:25.889942 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 461/956] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:25 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:26.000382 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-73cc93e1-811f-4d23-a63f-1c87b86c8885 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:26.000998 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-73cc93e1-811f-4d23-a63f-1c87b86c8885 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:26.009705 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-73cc93e1-811f-4d23-a63f-1c87b86c8885 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:26.010426 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-73cc93e1-811f-4d23-a63f-1c87b86c8885 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:26.011310 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-73cc93e1-811f-4d23-a63f-1c87b86c8885 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:26.011817 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-73cc93e1-811f-4d23-a63f-1c87b86c8885 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:26.156788 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-73cc93e1-811f-4d23-a63f-1c87b86c8885 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:26.165493 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-73cc93e1-811f-4d23-a63f-1c87b86c8885 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:26.167140 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-73cc93e1-811f-4d23-a63f-1c87b86c8885 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:26.168652 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-73cc93e1-811f-4d23-a63f-1c87b86c8885 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1738 microversion: 2.20 time: 0.172418 Jun 16 21:19:26.169869 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 496/957] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:25 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:26.909535 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-547ad218-80d1-4495-ab9e-4d52d54e33fd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:26.910893 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-547ad218-80d1-4495-ab9e-4d52d54e33fd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:26.917808 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-547ad218-80d1-4495-ab9e-4d52d54e33fd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:26.918514 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-547ad218-80d1-4495-ab9e-4d52d54e33fd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:26.919516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-547ad218-80d1-4495-ab9e-4d52d54e33fd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:26.920602 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-547ad218-80d1-4495-ab9e-4d52d54e33fd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:27.068394 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-547ad218-80d1-4495-ab9e-4d52d54e33fd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:27.076422 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-547ad218-80d1-4495-ab9e-4d52d54e33fd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1691 microversion: 2.1 time: 0.172288 Jun 16 21:19:27.077074 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 462/958] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:26 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:27.202183 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-09710d11-cdb7-40cf-b964-914701ca1662 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:27.202183 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-09710d11-cdb7-40cf-b964-914701ca1662 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:27.202183 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-09710d11-cdb7-40cf-b964-914701ca1662 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:27.202183 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-09710d11-cdb7-40cf-b964-914701ca1662 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:27.203184 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-09710d11-cdb7-40cf-b964-914701ca1662 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:27.203184 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-09710d11-cdb7-40cf-b964-914701ca1662 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:27.637279 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-09710d11-cdb7-40cf-b964-914701ca1662 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:27.645523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-09710d11-cdb7-40cf-b964-914701ca1662 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:27.647032 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-09710d11-cdb7-40cf-b964-914701ca1662 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:27.648244 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-09710d11-cdb7-40cf-b964-914701ca1662 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1738 microversion: 2.20 time: 0.464936 Jun 16 21:19:27.648807 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 497/959] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:27 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1738 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:28.093493 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-487315f9-07aa-4651-9a98-e29960bd4030 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:28.094101 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-487315f9-07aa-4651-9a98-e29960bd4030 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:28.102712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-487315f9-07aa-4651-9a98-e29960bd4030 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:28.103157 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-487315f9-07aa-4651-9a98-e29960bd4030 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:28.103920 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-487315f9-07aa-4651-9a98-e29960bd4030 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:28.104555 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-487315f9-07aa-4651-9a98-e29960bd4030 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:28.179378 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-487315f9-07aa-4651-9a98-e29960bd4030 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:28.188552 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-487315f9-07aa-4651-9a98-e29960bd4030 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 200 len: 1623 microversion: 2.1 time: 0.098932 Jun 16 21:19:28.189377 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 463/960] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:28 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 1623 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:19:28.337095 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-ba6c0be2-ea52-44da-b5d8-4a0ebadab412 req-b007e69a-ffea-428c-b8c6-a4378b633f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24b1c256-3ab9-4d48-a2d3-eca09c3159f1", "name": "network-vif-deleted", "tag": "05b93a42-bdde-493e-9e4e-b676213111c0"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:19:28.348677 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-ba6c0be2-ea52-44da-b5d8-4a0ebadab412 req-b007e69a-ffea-428c-b8c6-a4378b633f9e service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:28.349125 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-ba6c0be2-ea52-44da-b5d8-4a0ebadab412 req-b007e69a-ffea-428c-b8c6-a4378b633f9e service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:28.365055 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-ba6c0be2-ea52-44da-b5d8-4a0ebadab412 req-b007e69a-ffea-428c-b8c6-a4378b633f9e service nova] Creating event network-vif-deleted:05b93a42-bdde-493e-9e4e-b676213111c0 for instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 on hv-cinder-81914 Jun 16 21:19:28.371049 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-ba6c0be2-ea52-44da-b5d8-4a0ebadab412 req-b007e69a-ffea-428c-b8c6-a4378b633f9e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037871 Jun 16 21:19:28.371655 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 498/961] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:19:28.666842 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a62cca1a-6699-4d5b-b554-3856d23aae34 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:28.667407 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a62cca1a-6699-4d5b-b554-3856d23aae34 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:28.673778 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a62cca1a-6699-4d5b-b554-3856d23aae34 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:28.674159 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a62cca1a-6699-4d5b-b554-3856d23aae34 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:28.675937 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a62cca1a-6699-4d5b-b554-3856d23aae34 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:28.676709 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a62cca1a-6699-4d5b-b554-3856d23aae34 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:28.873069 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a62cca1a-6699-4d5b-b554-3856d23aae34 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:28.875444 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=100 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:28.886201 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a62cca1a-6699-4d5b-b554-3856d23aae34 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:28.892560 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a62cca1a-6699-4d5b-b554-3856d23aae34 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:28.893877 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a62cca1a-6699-4d5b-b554-3856d23aae34 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1720 microversion: 2.20 time: 0.231046 Jun 16 21:19:28.894748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 464/962] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:28 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1720 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:29.207011 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-169afacc-4b84-478e-971b-5b3e4da5b6e1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:29.207883 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-169afacc-4b84-478e-971b-5b3e4da5b6e1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 24b1c256-3ab9-4d48-a2d3-eca09c3159f1] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:29.214380 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-169afacc-4b84-478e-971b-5b3e4da5b6e1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:29.214824 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-169afacc-4b84-478e-971b-5b3e4da5b6e1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:29.215604 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-169afacc-4b84-478e-971b-5b3e4da5b6e1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:29.216041 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-169afacc-4b84-478e-971b-5b3e4da5b6e1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:29.229913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-169afacc-4b84-478e-971b-5b3e4da5b6e1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] HTTP exception thrown: Instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 could not be found. Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-169afacc-4b84-478e-971b-5b3e4da5b6e1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Request method failure captured: Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 HTTP/1.1 Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq507epJ_aTadF1Dd3rdHpBGlGRf4wX2wIMRrVEIy3GJv1cGUncdSTggT3o9d1eY2ow3SkuABL36GC1u31rXJx0UKPHWR1fNJBZP9pTZGMEU61bDRMu4A9RHCrRkLu91ThMUkD7yCVbJCHJ74gAcATick2BtzDKets9fD-77KD88q3xc Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 6b341c2d77764f3890f2501cfc6945a7 Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-273390268 Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:19:29.231564 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:19:29.233233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b341c2d77764f3890f2501cfc6945a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6b341c2d77764f3890f2501cfc6945a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b341c2d77764f3890f2501cfc6945a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6b341c2d77764f3890f2501cfc6945a7"}]}] Jun 16 21:19:29.233233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-ServerRescueNegativeTestJSON-273390268 Jun 16 21:19:29.233233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 6b341c2d77764f3890f2501cfc6945a7 Jun 16 21:19:29.233233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-273390268 Jun 16 21:19:29.233233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-ServerRescueNegativeTestJSON-273390268-project Jun 16 21:19:29.233233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:19:29.233233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:19:29.233233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 1d410832e6584828875128e31baa0ae8 Jun 16 21:19:29.233233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-ServerRescueNegativeTestJSON-273390268-project Jun 16 21:19:29.233233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:19:29.233233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 could not be found. Jun 16 21:19:29.233233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '24b1c256-3ab9-4d48-a2d3-eca09c3159f1'} Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 could not be found. Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:19:29.234164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 could not be found. Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 could not be found. Jun 16 21:19:29.235722 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:19:29.237052 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-169afacc-4b84-478e-971b-5b3e4da5b6e1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Returning 404 to user: Instance 24b1c256-3ab9-4d48-a2d3-eca09c3159f1 could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:19:29.237052 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-169afacc-4b84-478e-971b-5b3e4da5b6e1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1" status: 404 len: 111 microversion: 2.1 time: 0.030706 Jun 16 21:19:29.237052 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 499/963] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:29 2022] GET /compute/v2.1/servers/24b1c256-3ab9-4d48-a2d3-eca09c3159f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:19:29.243745 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-e892243a-9bce-4fd4-932b-5ff76a3996b8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '.version_select at 0x7fb3f75a11f0>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:29.263411 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-e892243a-9bce-4fd4-932b-5ff76a3996b8 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234058811" status: 202 len: 0 microversion: 2.1 time: 0.023674 Jun 16 21:19:29.263990 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 465/964] 10.222.0.43 () {58 vars in 1220 bytes} [Thu Jun 16 21:19:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234058811 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:19:29.912930 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-bc353e50-de7a-4d7e-a129-932ff48f6aa5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:29.913544 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-bc353e50-de7a-4d7e-a129-932ff48f6aa5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:29.920119 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bc353e50-de7a-4d7e-a129-932ff48f6aa5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:29.920594 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bc353e50-de7a-4d7e-a129-932ff48f6aa5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:29.921391 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bc353e50-de7a-4d7e-a129-932ff48f6aa5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:29.921794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bc353e50-de7a-4d7e-a129-932ff48f6aa5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:30.054692 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bc353e50-de7a-4d7e-a129-932ff48f6aa5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:30.062611 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bc353e50-de7a-4d7e-a129-932ff48f6aa5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:30.064099 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bc353e50-de7a-4d7e-a129-932ff48f6aa5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:30.065285 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-bc353e50-de7a-4d7e-a129-932ff48f6aa5 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1720 microversion: 2.20 time: 0.156378 Jun 16 21:19:30.065877 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 500/965] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:29 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:31.084444 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6e5b6f58-a4ea-412e-8a5f-e5d31910d937 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:31.085060 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6e5b6f58-a4ea-412e-8a5f-e5d31910d937 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:31.095780 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6e5b6f58-a4ea-412e-8a5f-e5d31910d937 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:31.096249 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6e5b6f58-a4ea-412e-8a5f-e5d31910d937 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:31.097202 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6e5b6f58-a4ea-412e-8a5f-e5d31910d937 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:31.097634 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6e5b6f58-a4ea-412e-8a5f-e5d31910d937 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:31.240680 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6e5b6f58-a4ea-412e-8a5f-e5d31910d937 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:31.250147 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6e5b6f58-a4ea-412e-8a5f-e5d31910d937 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:31.253078 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6e5b6f58-a4ea-412e-8a5f-e5d31910d937 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:31.255038 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6e5b6f58-a4ea-412e-8a5f-e5d31910d937 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1663 microversion: 2.20 time: 0.175827 Jun 16 21:19:31.255666 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 466/966] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:31 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1663 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:31.275106 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-05d519cb-232c-495d-8c86-caf0fa5cab87 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff7476c6-6fac-40ca-8215-ac05ebef437d"}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:19:31.276200 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-05d519cb-232c-495d-8c86-caf0fa5cab87 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:31.283460 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-05d519cb-232c-495d-8c86-caf0fa5cab87 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:31.284148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-05d519cb-232c-495d-8c86-caf0fa5cab87 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:31.285131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-05d519cb-232c-495d-8c86-caf0fa5cab87 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:31.286634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-05d519cb-232c-495d-8c86-caf0fa5cab87 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:31.603074 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-a80f9ee2-42d0-4034-a071-df4205c7c943 req-a7d88bac-b9b5-4fe2-8a4c-a8f43659b0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1b5610-fa96-44cf-b05b-41a354370d1c", "name": "network-vif-unplugged", "status": "completed", "tag": "ce808840-2e04-4b62-89bc-caeba961a739"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:19:31.614629 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-a80f9ee2-42d0-4034-a071-df4205c7c943 req-a7d88bac-b9b5-4fe2-8a4c-a8f43659b0df service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:31.615317 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-a80f9ee2-42d0-4034-a071-df4205c7c943 req-a7d88bac-b9b5-4fe2-8a4c-a8f43659b0df service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:31.619216 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-05d519cb-232c-495d-8c86-caf0fa5cab87 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "POST /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.348484 Jun 16 21:19:31.619830 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 501/967] 10.222.0.43 () {62 vars in 1363 bytes} [Thu Jun 16 21:19:31 2022] POST /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c/os-volume_attachments => generated 188 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 21:19:31.627904 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.compute.server_external_events [req-a80f9ee2-42d0-4034-a071-df4205c7c943 req-a7d88bac-b9b5-4fe2-8a4c-a8f43659b0df service nova] Unable to find a host for instance 6a1b5610-fa96-44cf-b05b-41a354370d1c. Dropping event network-vif-unplugged {{(pid=117738) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 21:19:31.628827 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-a80f9ee2-42d0-4034-a071-df4205c7c943 req-a7d88bac-b9b5-4fe2-8a4c-a8f43659b0df service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033820 Jun 16 21:19:31.630967 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 467/968] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 21:19:31.736973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7a27e008-6ee4-4dea-ad33-9f816d879ab3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:31.737466 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7a27e008-6ee4-4dea-ad33-9f816d879ab3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:31.744719 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7a27e008-6ee4-4dea-ad33-9f816d879ab3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:31.745161 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7a27e008-6ee4-4dea-ad33-9f816d879ab3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:31.745923 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7a27e008-6ee4-4dea-ad33-9f816d879ab3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:31.746352 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7a27e008-6ee4-4dea-ad33-9f816d879ab3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:31.971048 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7a27e008-6ee4-4dea-ad33-9f816d879ab3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c/os-volume_attachments/ff7476c6-6fac-40ca-8215-ac05ebef437d" status: 202 len: 0 microversion: 2.20 time: 0.238010 Jun 16 21:19:31.971630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 502/969] 10.222.0.43 () {60 vars in 1456 bytes} [Thu Jun 16 21:19:31 2022] DELETE /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c/os-volume_attachments/ff7476c6-6fac-40ca-8215-ac05ebef437d => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:19:32.027064 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-534dc3bc-7b04-48b4-8d0a-594b9312a647 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:19:32.027682 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-534dc3bc-7b04-48b4-8d0a-594b9312a647 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:32.033571 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-534dc3bc-7b04-48b4-8d0a-594b9312a647 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:32.034014 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-534dc3bc-7b04-48b4-8d0a-594b9312a647 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:32.034773 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-534dc3bc-7b04-48b4-8d0a-594b9312a647 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:32.035206 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-534dc3bc-7b04-48b4-8d0a-594b9312a647 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:32.111717 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-534dc3bc-7b04-48b4-8d0a-594b9312a647 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "POST /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c/action" status: 202 len: 0 microversion: 2.20 time: 0.088527 Jun 16 21:19:32.112721 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 468/970] 10.222.0.43 () {62 vars in 1318 bytes} [Thu Jun 16 21:19:32 2022] POST /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:19:32.122254 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-18db97ab-4dde-478e-813e-07b3ca0c56f6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:32.123431 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-18db97ab-4dde-478e-813e-07b3ca0c56f6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:32.128896 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-18db97ab-4dde-478e-813e-07b3ca0c56f6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:32.129908 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-18db97ab-4dde-478e-813e-07b3ca0c56f6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:32.130973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-18db97ab-4dde-478e-813e-07b3ca0c56f6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:32.131111 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-18db97ab-4dde-478e-813e-07b3ca0c56f6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:32.144134 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-bf0548ef-4416-4594-9ee6-f66bbaa87efb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:32.144892 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-bf0548ef-4416-4594-9ee6-f66bbaa87efb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:32.151001 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bf0548ef-4416-4594-9ee6-f66bbaa87efb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:32.151484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bf0548ef-4416-4594-9ee6-f66bbaa87efb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:32.152286 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bf0548ef-4416-4594-9ee6-f66bbaa87efb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:32.152726 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bf0548ef-4416-4594-9ee6-f66bbaa87efb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:32.179183 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-bf0548ef-4416-4594-9ee6-f66bbaa87efb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Going to try to terminate instance {{(pid=117738) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:19:32.260672 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-bf0548ef-4416-4594-9ee6-f66bbaa87efb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "DELETE /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 204 len: 0 microversion: 2.1 time: 0.119982 Jun 16 21:19:32.262125 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 469/971] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:19:32 2022] DELETE /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:19:32.273176 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0e145106-9b4a-490c-8163-83f00779b860 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:32.274175 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0e145106-9b4a-490c-8163-83f00779b860 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:32.281264 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0e145106-9b4a-490c-8163-83f00779b860 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:32.281644 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0e145106-9b4a-490c-8163-83f00779b860 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:32.282534 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0e145106-9b4a-490c-8163-83f00779b860 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:32.282974 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0e145106-9b4a-490c-8163-83f00779b860 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:32.291115 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-18db97ab-4dde-478e-813e-07b3ca0c56f6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:32.299019 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-18db97ab-4dde-478e-813e-07b3ca0c56f6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:32.300566 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-18db97ab-4dde-478e-813e-07b3ca0c56f6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:32.302288 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-18db97ab-4dde-478e-813e-07b3ca0c56f6 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1671 microversion: 2.20 time: 0.184174 Jun 16 21:19:32.304506 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 503/972] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:32 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1671 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:32.421556 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0e145106-9b4a-490c-8163-83f00779b860 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:32.429721 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0e145106-9b4a-490c-8163-83f00779b860 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1509 microversion: 2.1 time: 0.163825 Jun 16 21:19:32.430288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 470/973] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:32 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:19:33.321387 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4b60bba3-d5c3-4f80-94ec-d7bfde63736a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:33.322013 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4b60bba3-d5c3-4f80-94ec-d7bfde63736a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:33.328604 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b60bba3-d5c3-4f80-94ec-d7bfde63736a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:33.329053 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b60bba3-d5c3-4f80-94ec-d7bfde63736a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:33.329823 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b60bba3-d5c3-4f80-94ec-d7bfde63736a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:33.330589 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4b60bba3-d5c3-4f80-94ec-d7bfde63736a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:33.386865 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a1665084-5b0a-4909-88ac-f27ae828afb2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:33.387457 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a1665084-5b0a-4909-88ac-f27ae828afb2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:33.393831 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a1665084-5b0a-4909-88ac-f27ae828afb2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:33.394274 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a1665084-5b0a-4909-88ac-f27ae828afb2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:33.395057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a1665084-5b0a-4909-88ac-f27ae828afb2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:33.395485 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a1665084-5b0a-4909-88ac-f27ae828afb2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:33.419151 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a1665084-5b0a-4909-88ac-f27ae828afb2 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18/ips" status: 200 len: 151 microversion: 2.1 time: 0.036002 Jun 16 21:19:33.419845 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 471/974] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 16 21:19:33 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:19:33.446399 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5e5dac7a-3e06-40c2-a5a6-d1b8a7536bac tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:33.447013 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5e5dac7a-3e06-40c2-a5a6-d1b8a7536bac tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:33.453061 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5e5dac7a-3e06-40c2-a5a6-d1b8a7536bac tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:33.453499 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5e5dac7a-3e06-40c2-a5a6-d1b8a7536bac tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:33.454257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5e5dac7a-3e06-40c2-a5a6-d1b8a7536bac tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:33.454683 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5e5dac7a-3e06-40c2-a5a6-d1b8a7536bac tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:33.470630 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4b60bba3-d5c3-4f80-94ec-d7bfde63736a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:33.479692 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4b60bba3-d5c3-4f80-94ec-d7bfde63736a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:33.481633 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4b60bba3-d5c3-4f80-94ec-d7bfde63736a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:33.483034 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4b60bba3-d5c3-4f80-94ec-d7bfde63736a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1671 microversion: 2.20 time: 0.165566 Jun 16 21:19:33.491336 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 504/975] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:33 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:33.591788 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5e5dac7a-3e06-40c2-a5a6-d1b8a7536bac tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:33.599916 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5e5dac7a-3e06-40c2-a5a6-d1b8a7536bac tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1509 microversion: 2.1 time: 0.157191 Jun 16 21:19:33.600731 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 472/976] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:33 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:34.501914 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8de830fa-bdbf-44ed-a0eb-8d7354ac9818 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:34.502522 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8de830fa-bdbf-44ed-a0eb-8d7354ac9818 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:34.505563 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:34.510801 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8de830fa-bdbf-44ed-a0eb-8d7354ac9818 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:34.511249 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8de830fa-bdbf-44ed-a0eb-8d7354ac9818 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:34.512017 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8de830fa-bdbf-44ed-a0eb-8d7354ac9818 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:34.512483 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8de830fa-bdbf-44ed-a0eb-8d7354ac9818 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:34.618169 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0eacbbe9-5941-4928-808b-32f986419ba1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:34.619040 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0eacbbe9-5941-4928-808b-32f986419ba1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:34.625646 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0eacbbe9-5941-4928-808b-32f986419ba1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:34.626091 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0eacbbe9-5941-4928-808b-32f986419ba1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:34.626883 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0eacbbe9-5941-4928-808b-32f986419ba1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:34.627318 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0eacbbe9-5941-4928-808b-32f986419ba1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:34.646243 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8de830fa-bdbf-44ed-a0eb-8d7354ac9818 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:34.654619 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8de830fa-bdbf-44ed-a0eb-8d7354ac9818 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:34.656250 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8de830fa-bdbf-44ed-a0eb-8d7354ac9818 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:34.657671 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8de830fa-bdbf-44ed-a0eb-8d7354ac9818 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1671 microversion: 2.20 time: 0.159696 Jun 16 21:19:34.658290 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 505/977] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:34 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:34.759703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0842344b-db40-4d87-90a8-bf2f4b3a1da7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db0b7c92-e177-452b-9933-9a23e7f765ea"}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:19:34.761176 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0842344b-db40-4d87-90a8-bf2f4b3a1da7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:34.767515 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0842344b-db40-4d87-90a8-bf2f4b3a1da7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:34.767953 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0842344b-db40-4d87-90a8-bf2f4b3a1da7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:34.768750 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0842344b-db40-4d87-90a8-bf2f4b3a1da7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:34.769179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0842344b-db40-4d87-90a8-bf2f4b3a1da7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:34.773522 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0eacbbe9-5941-4928-808b-32f986419ba1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:34.781119 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0eacbbe9-5941-4928-808b-32f986419ba1 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1509 microversion: 2.1 time: 0.167975 Jun 16 21:19:34.781768 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 473/978] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:34 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:35.142983 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:35.292474 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0842344b-db40-4d87-90a8-bf2f4b3a1da7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "POST /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.536615 Jun 16 21:19:35.293182 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 506/979] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 16 21:19:34 2022] POST /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18/os-volume_attachments => generated 194 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:19:35.584808 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-fde8477f-c4c6-4ed7-a369-9f2f6fd9e11c req-f3ea2cf2-e15d-477d-8112-dfc02196ffb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087f8794-8313-46f9-804b-3d8ac048266b", "name": "network-vif-deleted", "tag": "5fc46882-3511-4c90-846e-a7b5cec70e4a"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:19:35.601489 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-fde8477f-c4c6-4ed7-a369-9f2f6fd9e11c req-f3ea2cf2-e15d-477d-8112-dfc02196ffb0 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:35.601914 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-fde8477f-c4c6-4ed7-a369-9f2f6fd9e11c req-f3ea2cf2-e15d-477d-8112-dfc02196ffb0 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:35.614331 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-fde8477f-c4c6-4ed7-a369-9f2f6fd9e11c req-f3ea2cf2-e15d-477d-8112-dfc02196ffb0 service nova] Creating event network-vif-deleted:5fc46882-3511-4c90-846e-a7b5cec70e4a for instance 087f8794-8313-46f9-804b-3d8ac048266b on hv-cinder-81914 Jun 16 21:19:35.620832 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-fde8477f-c4c6-4ed7-a369-9f2f6fd9e11c req-f3ea2cf2-e15d-477d-8112-dfc02196ffb0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039617 Jun 16 21:19:35.624853 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 474/980] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:19:35.678853 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-58e98fe2-df51-44fa-bb17-78fd6640d521 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:35.679548 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-58e98fe2-df51-44fa-bb17-78fd6640d521 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:35.686341 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-58e98fe2-df51-44fa-bb17-78fd6640d521 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:35.686771 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-58e98fe2-df51-44fa-bb17-78fd6640d521 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:35.687537 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-58e98fe2-df51-44fa-bb17-78fd6640d521 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:35.688148 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-58e98fe2-df51-44fa-bb17-78fd6640d521 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:35.915695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-f909536e-57e0-4e39-a1e4-915ebe4e8d27 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:35.916741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-f909536e-57e0-4e39-a1e4-915ebe4e8d27 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:35.923715 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f909536e-57e0-4e39-a1e4-915ebe4e8d27 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:35.924280 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f909536e-57e0-4e39-a1e4-915ebe4e8d27 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:35.925057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f909536e-57e0-4e39-a1e4-915ebe4e8d27 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:35.926030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f909536e-57e0-4e39-a1e4-915ebe4e8d27 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:35.960450 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f909536e-57e0-4e39-a1e4-915ebe4e8d27 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:35.961300 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f909536e-57e0-4e39-a1e4-915ebe4e8d27 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:35.961909 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.objects.instance [None req-f909536e-57e0-4e39-a1e4-915ebe4e8d27 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lazy-loading 'fault' on Instance uuid 087f8794-8313-46f9-804b-3d8ac048266b {{(pid=117738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:19:35.979892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-58e98fe2-df51-44fa-bb17-78fd6640d521 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:35.988320 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-58e98fe2-df51-44fa-bb17-78fd6640d521 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:35.990180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-58e98fe2-df51-44fa-bb17-78fd6640d521 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:35.991589 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-58e98fe2-df51-44fa-bb17-78fd6640d521 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.318244 Jun 16 21:19:36.003807 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 507/981] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:35 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:36.021694 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-f909536e-57e0-4e39-a1e4-915ebe4e8d27 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:36.031734 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-f909536e-57e0-4e39-a1e4-915ebe4e8d27 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 200 len: 1312 microversion: 2.1 time: 0.237829 Jun 16 21:19:36.041574 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 475/982] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:35 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 1312 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:19:36.415844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c9b20e07-f1e1-464b-8f3b-24fb1fafd8f3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:36.416428 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c9b20e07-f1e1-464b-8f3b-24fb1fafd8f3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:36.423380 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c9b20e07-f1e1-464b-8f3b-24fb1fafd8f3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:36.424083 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c9b20e07-f1e1-464b-8f3b-24fb1fafd8f3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:36.424359 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-9941043a-713a-41c1-aaac-c3270794dd95 req-a53806e0-4f03-487c-a4f5-3605d46ed55c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "329313fc-d559-41c6-9dad-471e57c9751e", "tag": "dbb3b245-c7c5-45cc-8bc9-e46efbfd90bb"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:19:36.425499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c9b20e07-f1e1-464b-8f3b-24fb1fafd8f3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:36.426124 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c9b20e07-f1e1-464b-8f3b-24fb1fafd8f3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:36.438391 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-9941043a-713a-41c1-aaac-c3270794dd95 req-a53806e0-4f03-487c-a4f5-3605d46ed55c service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:36.439421 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-9941043a-713a-41c1-aaac-c3270794dd95 req-a53806e0-4f03-487c-a4f5-3605d46ed55c service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:36.453570 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-9941043a-713a-41c1-aaac-c3270794dd95 req-a53806e0-4f03-487c-a4f5-3605d46ed55c service nova] Creating event network-changed:dbb3b245-c7c5-45cc-8bc9-e46efbfd90bb for instance 329313fc-d559-41c6-9dad-471e57c9751e on hv-cinder-81914 Jun 16 21:19:36.458092 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c9b20e07-f1e1-464b-8f3b-24fb1fafd8f3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Going to try to terminate instance {{(pid=117737) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:19:36.460092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-9941043a-713a-41c1-aaac-c3270794dd95 req-a53806e0-4f03-487c-a4f5-3605d46ed55c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045349 Jun 16 21:19:36.460818 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 476/983] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:19:36.536321 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c9b20e07-f1e1-464b-8f3b-24fb1fafd8f3 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "DELETE /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 204 len: 0 microversion: 2.1 time: 0.124642 Jun 16 21:19:36.540126 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 508/984] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:19:36 2022] DELETE /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:19:36.545714 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-53f5bc3a-f5b7-4370-9ce1-802c32be4c97 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:36.546432 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-53f5bc3a-f5b7-4370-9ce1-802c32be4c97 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:36.560652 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-53f5bc3a-f5b7-4370-9ce1-802c32be4c97 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:36.561097 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-53f5bc3a-f5b7-4370-9ce1-802c32be4c97 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:36.561872 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-53f5bc3a-f5b7-4370-9ce1-802c32be4c97 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:36.562368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-53f5bc3a-f5b7-4370-9ce1-802c32be4c97 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:36.705234 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-53f5bc3a-f5b7-4370-9ce1-802c32be4c97 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:36.713277 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-53f5bc3a-f5b7-4370-9ce1-802c32be4c97 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.171718 Jun 16 21:19:36.713869 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 477/985] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:36 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:37.011115 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-deee294c-1b31-4cfc-ab1d-88a5d93e5498 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:37.011815 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-deee294c-1b31-4cfc-ab1d-88a5d93e5498 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:37.017700 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-deee294c-1b31-4cfc-ab1d-88a5d93e5498 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:37.018150 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-deee294c-1b31-4cfc-ab1d-88a5d93e5498 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:37.018915 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-deee294c-1b31-4cfc-ab1d-88a5d93e5498 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:37.019351 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-deee294c-1b31-4cfc-ab1d-88a5d93e5498 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:37.049767 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9735ce4d-ef9f-4ed9-8a56-04ea0badc423 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:37.050430 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-9735ce4d-ef9f-4ed9-8a56-04ea0badc423 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 087f8794-8313-46f9-804b-3d8ac048266b] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:37.065376 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9735ce4d-ef9f-4ed9-8a56-04ea0badc423 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:37.065825 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9735ce4d-ef9f-4ed9-8a56-04ea0badc423 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:37.066678 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9735ce4d-ef9f-4ed9-8a56-04ea0badc423 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:37.067334 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9735ce4d-ef9f-4ed9-8a56-04ea0badc423 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:37.083103 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-9735ce4d-ef9f-4ed9-8a56-04ea0badc423 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] HTTP exception thrown: Instance 087f8794-8313-46f9-804b-3d8ac048266b could not be found. Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9735ce4d-ef9f-4ed9-8a56-04ea0badc423 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Request method failure captured: Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b HTTP/1.1 Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq507epJ_aTadF1Dd3rdHpBGlGRf4wX2wIMRrVEIy3GJv1cGUncdSTggT3o9d1eY2ow3SkuABL36GC1u31rXJx0UKPHWR1fNJBZP9pTZGMEU61bDRMu4A9RHCrRkLu91ThMUkD7yCVbJCHJ74gAcATick2BtzDKets9fD-77KD88q3xc Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 6b341c2d77764f3890f2501cfc6945a7 Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-273390268 Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:19:37.084812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:19:37.086121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b341c2d77764f3890f2501cfc6945a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6b341c2d77764f3890f2501cfc6945a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b341c2d77764f3890f2501cfc6945a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6b341c2d77764f3890f2501cfc6945a7"}]}] Jun 16 21:19:37.086121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-ServerRescueNegativeTestJSON-273390268 Jun 16 21:19:37.086121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 6b341c2d77764f3890f2501cfc6945a7 Jun 16 21:19:37.086121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-273390268 Jun 16 21:19:37.086121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-ServerRescueNegativeTestJSON-273390268-project Jun 16 21:19:37.086121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:19:37.086121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:19:37.086121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 1d410832e6584828875128e31baa0ae8 Jun 16 21:19:37.086121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-ServerRescueNegativeTestJSON-273390268-project Jun 16 21:19:37.086121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:19:37.086121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 087f8794-8313-46f9-804b-3d8ac048266b could not be found. Jun 16 21:19:37.086121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '087f8794-8313-46f9-804b-3d8ac048266b'} Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 087f8794-8313-46f9-804b-3d8ac048266b could not be found. Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:19:37.086902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 087f8794-8313-46f9-804b-3d8ac048266b could not be found. Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 087f8794-8313-46f9-804b-3d8ac048266b could not be found. Jun 16 21:19:37.088142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:19:37.089292 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9735ce4d-ef9f-4ed9-8a56-04ea0badc423 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Returning 404 to user: Instance 087f8794-8313-46f9-804b-3d8ac048266b could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:19:37.089292 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-9735ce4d-ef9f-4ed9-8a56-04ea0badc423 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b" status: 404 len: 111 microversion: 2.1 time: 0.040955 Jun 16 21:19:37.089292 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 478/986] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:37 2022] GET /compute/v2.1/servers/087f8794-8313-46f9-804b-3d8ac048266b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 21:19:37.098965 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0879118b-623c-47d1-aba6-25b0dcbd87d6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:37.099691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0879118b-623c-47d1-aba6-25b0dcbd87d6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:37.106463 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0879118b-623c-47d1-aba6-25b0dcbd87d6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:37.107313 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0879118b-623c-47d1-aba6-25b0dcbd87d6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:37.108200 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0879118b-623c-47d1-aba6-25b0dcbd87d6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:37.109089 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0879118b-623c-47d1-aba6-25b0dcbd87d6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:37.137099 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0879118b-623c-47d1-aba6-25b0dcbd87d6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Going to try to terminate instance {{(pid=117738) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:19:37.164960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-deee294c-1b31-4cfc-ab1d-88a5d93e5498 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:37.173917 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-deee294c-1b31-4cfc-ab1d-88a5d93e5498 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:37.176702 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-deee294c-1b31-4cfc-ab1d-88a5d93e5498 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:37.178103 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-deee294c-1b31-4cfc-ab1d-88a5d93e5498 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.171276 Jun 16 21:19:37.178668 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 509/987] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:37 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:37.227518 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0879118b-623c-47d1-aba6-25b0dcbd87d6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "DELETE /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 204 len: 0 microversion: 2.1 time: 0.132702 Jun 16 21:19:37.228104 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 479/988] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:19:37 2022] DELETE /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 21:19:37.236275 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-27678f4a-a649-4330-b793-bd8d73688ba0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:37.236879 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-27678f4a-a649-4330-b793-bd8d73688ba0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:37.243882 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-27678f4a-a649-4330-b793-bd8d73688ba0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:37.244408 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-27678f4a-a649-4330-b793-bd8d73688ba0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:37.245177 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-27678f4a-a649-4330-b793-bd8d73688ba0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:37.245775 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-27678f4a-a649-4330-b793-bd8d73688ba0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:37.392265 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-27678f4a-a649-4330-b793-bd8d73688ba0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:37.402193 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-27678f4a-a649-4330-b793-bd8d73688ba0 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.169757 Jun 16 21:19:37.402767 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 510/989] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:37 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:37.730812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-431cbc72-0a1d-48a5-b90c-f4441426ba0f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:37.731468 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-431cbc72-0a1d-48a5-b90c-f4441426ba0f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:37.737504 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-431cbc72-0a1d-48a5-b90c-f4441426ba0f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:37.737949 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-431cbc72-0a1d-48a5-b90c-f4441426ba0f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:37.738903 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-431cbc72-0a1d-48a5-b90c-f4441426ba0f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:37.739369 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-431cbc72-0a1d-48a5-b90c-f4441426ba0f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:37.898381 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-431cbc72-0a1d-48a5-b90c-f4441426ba0f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:37.900815 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:37.908524 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-431cbc72-0a1d-48a5-b90c-f4441426ba0f tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.181894 Jun 16 21:19:37.909076 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 480/990] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:37 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:38.198233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d1c12d91-7f96-455e-a4fc-7c287e3952a0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:38.198832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d1c12d91-7f96-455e-a4fc-7c287e3952a0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:38.205386 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d1c12d91-7f96-455e-a4fc-7c287e3952a0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:38.205827 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d1c12d91-7f96-455e-a4fc-7c287e3952a0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:38.206599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d1c12d91-7f96-455e-a4fc-7c287e3952a0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:38.207035 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d1c12d91-7f96-455e-a4fc-7c287e3952a0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:38.419235 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a1394aca-d35e-48e9-b8a9-3a7ad3d7a4f6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:38.419861 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a1394aca-d35e-48e9-b8a9-3a7ad3d7a4f6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:38.428725 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a1394aca-d35e-48e9-b8a9-3a7ad3d7a4f6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:38.429179 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a1394aca-d35e-48e9-b8a9-3a7ad3d7a4f6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:38.430246 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a1394aca-d35e-48e9-b8a9-3a7ad3d7a4f6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:38.430683 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a1394aca-d35e-48e9-b8a9-3a7ad3d7a4f6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:38.570642 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a1394aca-d35e-48e9-b8a9-3a7ad3d7a4f6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:38.579414 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a1394aca-d35e-48e9-b8a9-3a7ad3d7a4f6 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.164201 Jun 16 21:19:38.580205 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 481/991] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:38 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:19:38.586992 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d1c12d91-7f96-455e-a4fc-7c287e3952a0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:38.599470 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d1c12d91-7f96-455e-a4fc-7c287e3952a0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:38.601008 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d1c12d91-7f96-455e-a4fc-7c287e3952a0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:38.602204 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d1c12d91-7f96-455e-a4fc-7c287e3952a0 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.407881 Jun 16 21:19:38.602799 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 511/992] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:38 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:38.926908 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7ace0ca5-6724-4552-8d6e-73328cc5fe42 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:38.927522 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7ace0ca5-6724-4552-8d6e-73328cc5fe42 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:38.933741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7ace0ca5-6724-4552-8d6e-73328cc5fe42 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:38.934179 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7ace0ca5-6724-4552-8d6e-73328cc5fe42 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:38.934928 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7ace0ca5-6724-4552-8d6e-73328cc5fe42 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:38.935379 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7ace0ca5-6724-4552-8d6e-73328cc5fe42 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:39.069910 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-7ace0ca5-6724-4552-8d6e-73328cc5fe42 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:39.077609 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7ace0ca5-6724-4552-8d6e-73328cc5fe42 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.155073 Jun 16 21:19:39.078170 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 482/993] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:38 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:39.598793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ba85e9bc-ea22-43e1-85a8-0d83a3b9d243 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:39.599503 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ba85e9bc-ea22-43e1-85a8-0d83a3b9d243 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:39.607275 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ba85e9bc-ea22-43e1-85a8-0d83a3b9d243 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:39.607275 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ba85e9bc-ea22-43e1-85a8-0d83a3b9d243 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:39.607945 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ba85e9bc-ea22-43e1-85a8-0d83a3b9d243 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:39.608441 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ba85e9bc-ea22-43e1-85a8-0d83a3b9d243 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:39.623061 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5833d21c-2ad6-408c-a982-db94d98ba0e3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:39.623671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5833d21c-2ad6-408c-a982-db94d98ba0e3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:39.630408 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5833d21c-2ad6-408c-a982-db94d98ba0e3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:39.630969 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5833d21c-2ad6-408c-a982-db94d98ba0e3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:39.631738 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5833d21c-2ad6-408c-a982-db94d98ba0e3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:39.632166 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5833d21c-2ad6-408c-a982-db94d98ba0e3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:39.740078 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-ba85e9bc-ea22-43e1-85a8-0d83a3b9d243 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:39.747774 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ba85e9bc-ea22-43e1-85a8-0d83a3b9d243 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.154464 Jun 16 21:19:39.748362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 512/994] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:39 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:39.763446 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5833d21c-2ad6-408c-a982-db94d98ba0e3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:39.772097 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5833d21c-2ad6-408c-a982-db94d98ba0e3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:39.773605 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5833d21c-2ad6-408c-a982-db94d98ba0e3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:39.774753 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5833d21c-2ad6-408c-a982-db94d98ba0e3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.155845 Jun 16 21:19:39.775293 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 483/995] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:39 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:19:40.094517 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1bfd6198-21c4-423d-90ad-0407944c729b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:40.095120 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1bfd6198-21c4-423d-90ad-0407944c729b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:40.101130 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1bfd6198-21c4-423d-90ad-0407944c729b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:40.101566 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1bfd6198-21c4-423d-90ad-0407944c729b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:40.102317 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1bfd6198-21c4-423d-90ad-0407944c729b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:40.102746 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1bfd6198-21c4-423d-90ad-0407944c729b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:40.239646 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1bfd6198-21c4-423d-90ad-0407944c729b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:40.247431 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1bfd6198-21c4-423d-90ad-0407944c729b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.156634 Jun 16 21:19:40.247985 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 513/996] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:40 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:40.764656 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b3113f09-1e33-4e52-b51d-0fdf200a3a91 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:40.765266 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b3113f09-1e33-4e52-b51d-0fdf200a3a91 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:40.771767 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b3113f09-1e33-4e52-b51d-0fdf200a3a91 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:40.772247 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b3113f09-1e33-4e52-b51d-0fdf200a3a91 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:40.773010 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b3113f09-1e33-4e52-b51d-0fdf200a3a91 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:40.773443 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b3113f09-1e33-4e52-b51d-0fdf200a3a91 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:40.792633 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b11ff2b6-dc3a-42f7-a67e-3493a460ed09 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:40.793381 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b11ff2b6-dc3a-42f7-a67e-3493a460ed09 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:40.799621 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b11ff2b6-dc3a-42f7-a67e-3493a460ed09 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:40.800061 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b11ff2b6-dc3a-42f7-a67e-3493a460ed09 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:40.800848 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b11ff2b6-dc3a-42f7-a67e-3493a460ed09 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:40.802103 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b11ff2b6-dc3a-42f7-a67e-3493a460ed09 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:40.905836 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b3113f09-1e33-4e52-b51d-0fdf200a3a91 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:40.913949 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b3113f09-1e33-4e52-b51d-0fdf200a3a91 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.153084 Jun 16 21:19:40.914512 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 484/997] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:40 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:40.935149 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b11ff2b6-dc3a-42f7-a67e-3493a460ed09 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:40.943074 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b11ff2b6-dc3a-42f7-a67e-3493a460ed09 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:40.944625 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b11ff2b6-dc3a-42f7-a67e-3493a460ed09 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:40.945783 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b11ff2b6-dc3a-42f7-a67e-3493a460ed09 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.156985 Jun 16 21:19:40.946329 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 514/998] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:40 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:19:41.265832 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6f9cd4ad-b5da-4317-ac08-7fd187309634 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:41.266805 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6f9cd4ad-b5da-4317-ac08-7fd187309634 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:41.274179 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6f9cd4ad-b5da-4317-ac08-7fd187309634 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:41.274616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6f9cd4ad-b5da-4317-ac08-7fd187309634 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:41.275385 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6f9cd4ad-b5da-4317-ac08-7fd187309634 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:41.275812 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6f9cd4ad-b5da-4317-ac08-7fd187309634 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:41.414365 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6f9cd4ad-b5da-4317-ac08-7fd187309634 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:41.423295 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6f9cd4ad-b5da-4317-ac08-7fd187309634 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.162009 Jun 16 21:19:41.423880 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 485/999] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:41 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:41.930814 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-2c3d8f54-2c33-4d4f-975b-4271cd2da1bd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:41.931633 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-2c3d8f54-2c33-4d4f-975b-4271cd2da1bd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:41.938593 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2c3d8f54-2c33-4d4f-975b-4271cd2da1bd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:41.939373 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2c3d8f54-2c33-4d4f-975b-4271cd2da1bd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:41.940414 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2c3d8f54-2c33-4d4f-975b-4271cd2da1bd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:41.941127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2c3d8f54-2c33-4d4f-975b-4271cd2da1bd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:41.965199 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1fa19680-b6d2-41a7-a9fa-91c6fea4d44a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:41.965798 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1fa19680-b6d2-41a7-a9fa-91c6fea4d44a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:41.972206 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1fa19680-b6d2-41a7-a9fa-91c6fea4d44a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:41.972647 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1fa19680-b6d2-41a7-a9fa-91c6fea4d44a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:41.974470 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1fa19680-b6d2-41a7-a9fa-91c6fea4d44a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:41.975002 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1fa19680-b6d2-41a7-a9fa-91c6fea4d44a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:42.091566 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2c3d8f54-2c33-4d4f-975b-4271cd2da1bd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:42.103808 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-2c3d8f54-2c33-4d4f-975b-4271cd2da1bd tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.176894 Jun 16 21:19:42.104747 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 515/1000] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:41 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:42.152322 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1fa19680-b6d2-41a7-a9fa-91c6fea4d44a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:42.162908 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1fa19680-b6d2-41a7-a9fa-91c6fea4d44a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:42.164445 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1fa19680-b6d2-41a7-a9fa-91c6fea4d44a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:42.165632 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1fa19680-b6d2-41a7-a9fa-91c6fea4d44a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.204395 Jun 16 21:19:42.166199 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 486/1001] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:41 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:19:42.439696 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-09e36a3e-07c4-47cc-b886-407344785894 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:42.440334 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-09e36a3e-07c4-47cc-b886-407344785894 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:42.447104 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-09e36a3e-07c4-47cc-b886-407344785894 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:42.447554 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-09e36a3e-07c4-47cc-b886-407344785894 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:42.448359 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-09e36a3e-07c4-47cc-b886-407344785894 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:42.449079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-09e36a3e-07c4-47cc-b886-407344785894 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:42.588281 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-09e36a3e-07c4-47cc-b886-407344785894 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:42.599199 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-09e36a3e-07c4-47cc-b886-407344785894 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.163240 Jun 16 21:19:42.599785 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 516/1002] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:42 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:43.123859 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d01ed3f6-331e-49a2-948a-5856fc1f3133 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:43.124496 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d01ed3f6-331e-49a2-948a-5856fc1f3133 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:43.131384 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d01ed3f6-331e-49a2-948a-5856fc1f3133 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:43.131834 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d01ed3f6-331e-49a2-948a-5856fc1f3133 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:43.132651 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d01ed3f6-331e-49a2-948a-5856fc1f3133 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:43.133084 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d01ed3f6-331e-49a2-948a-5856fc1f3133 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:43.183636 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-91766cef-2c95-4d95-a7f9-24eb60dc0373 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:43.184337 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-91766cef-2c95-4d95-a7f9-24eb60dc0373 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:43.191112 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-91766cef-2c95-4d95-a7f9-24eb60dc0373 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:43.191565 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-91766cef-2c95-4d95-a7f9-24eb60dc0373 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:43.192378 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-91766cef-2c95-4d95-a7f9-24eb60dc0373 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:43.193102 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-91766cef-2c95-4d95-a7f9-24eb60dc0373 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:43.278866 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d01ed3f6-331e-49a2-948a-5856fc1f3133 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:43.285205 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d01ed3f6-331e-49a2-948a-5856fc1f3133 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.165111 Jun 16 21:19:43.286544 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 487/1003] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:43 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:43.356360 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-91766cef-2c95-4d95-a7f9-24eb60dc0373 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:43.366195 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-91766cef-2c95-4d95-a7f9-24eb60dc0373 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:43.367921 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-91766cef-2c95-4d95-a7f9-24eb60dc0373 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:43.369717 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-91766cef-2c95-4d95-a7f9-24eb60dc0373 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.190114 Jun 16 21:19:43.381516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 517/1004] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:43 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:43.617132 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d5c2dd17-033f-40a2-a32a-cdcfd87bfd0b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:43.617889 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d5c2dd17-033f-40a2-a32a-cdcfd87bfd0b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:43.624305 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d5c2dd17-033f-40a2-a32a-cdcfd87bfd0b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:43.624932 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d5c2dd17-033f-40a2-a32a-cdcfd87bfd0b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:43.625710 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d5c2dd17-033f-40a2-a32a-cdcfd87bfd0b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:43.626149 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d5c2dd17-033f-40a2-a32a-cdcfd87bfd0b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:43.774609 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d5c2dd17-033f-40a2-a32a-cdcfd87bfd0b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:43.782743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d5c2dd17-033f-40a2-a32a-cdcfd87bfd0b tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.170203 Jun 16 21:19:43.783355 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 488/1005] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:43 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:44.303538 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-587b6eeb-4479-4708-80c7-fd3200998ceb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:44.304191 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-587b6eeb-4479-4708-80c7-fd3200998ceb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:44.311415 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-587b6eeb-4479-4708-80c7-fd3200998ceb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:44.311867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-587b6eeb-4479-4708-80c7-fd3200998ceb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:44.312675 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-587b6eeb-4479-4708-80c7-fd3200998ceb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:44.313111 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-587b6eeb-4479-4708-80c7-fd3200998ceb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:44.396826 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-ce7130f3-95fe-4ad6-95ad-ab53fd348371 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:44.397454 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-ce7130f3-95fe-4ad6-95ad-ab53fd348371 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:44.403981 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ce7130f3-95fe-4ad6-95ad-ab53fd348371 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:44.404560 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ce7130f3-95fe-4ad6-95ad-ab53fd348371 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:44.405426 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ce7130f3-95fe-4ad6-95ad-ab53fd348371 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:44.405927 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ce7130f3-95fe-4ad6-95ad-ab53fd348371 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:44.478836 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-587b6eeb-4479-4708-80c7-fd3200998ceb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:44.493243 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-587b6eeb-4479-4708-80c7-fd3200998ceb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.194165 Jun 16 21:19:44.494523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 518/1006] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:44 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:44.568742 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-ce7130f3-95fe-4ad6-95ad-ab53fd348371 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:44.578002 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-ce7130f3-95fe-4ad6-95ad-ab53fd348371 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:44.579924 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-ce7130f3-95fe-4ad6-95ad-ab53fd348371 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:44.581429 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-ce7130f3-95fe-4ad6-95ad-ab53fd348371 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.196593 Jun 16 21:19:44.582395 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 489/1007] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:44 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:19:44.800322 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-479cd931-122b-445f-9990-b9d47de47651 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:44.800960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-479cd931-122b-445f-9990-b9d47de47651 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:44.807276 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-479cd931-122b-445f-9990-b9d47de47651 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:44.807711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-479cd931-122b-445f-9990-b9d47de47651 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:44.808495 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-479cd931-122b-445f-9990-b9d47de47651 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:44.808915 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-479cd931-122b-445f-9990-b9d47de47651 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:44.972069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-479cd931-122b-445f-9990-b9d47de47651 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:44.980454 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-479cd931-122b-445f-9990-b9d47de47651 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.184115 Jun 16 21:19:44.981071 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 519/1008] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:44 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:45.513268 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9536cc79-92f6-46f9-a939-44890e5b2701 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:45.513941 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-9536cc79-92f6-46f9-a939-44890e5b2701 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:45.521414 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9536cc79-92f6-46f9-a939-44890e5b2701 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:45.526714 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9536cc79-92f6-46f9-a939-44890e5b2701 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:45.527588 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9536cc79-92f6-46f9-a939-44890e5b2701 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:45.528032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9536cc79-92f6-46f9-a939-44890e5b2701 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:45.607415 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-dfb49dcc-01e6-41d1-827d-b2fdf285f81e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:45.608135 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-dfb49dcc-01e6-41d1-827d-b2fdf285f81e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:45.614660 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dfb49dcc-01e6-41d1-827d-b2fdf285f81e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:45.615107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dfb49dcc-01e6-41d1-827d-b2fdf285f81e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:45.615918 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dfb49dcc-01e6-41d1-827d-b2fdf285f81e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:45.616439 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dfb49dcc-01e6-41d1-827d-b2fdf285f81e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:45.686923 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9536cc79-92f6-46f9-a939-44890e5b2701 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:45.695258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-9536cc79-92f6-46f9-a939-44890e5b2701 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.185756 Jun 16 21:19:45.696039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 490/1009] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:45 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:45.766095 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-dfb49dcc-01e6-41d1-827d-b2fdf285f81e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:45.776255 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-dfb49dcc-01e6-41d1-827d-b2fdf285f81e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:45.777779 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-dfb49dcc-01e6-41d1-827d-b2fdf285f81e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:45.778974 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-dfb49dcc-01e6-41d1-827d-b2fdf285f81e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.183071 Jun 16 21:19:45.779537 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 520/1010] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:45 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:19:45.998542 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-847259a7-f1b8-46e3-8723-51718571cd39 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:45.999600 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-847259a7-f1b8-46e3-8723-51718571cd39 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:46.006745 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-847259a7-f1b8-46e3-8723-51718571cd39 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:46.007573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-847259a7-f1b8-46e3-8723-51718571cd39 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:46.008588 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-847259a7-f1b8-46e3-8723-51718571cd39 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:46.009090 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-847259a7-f1b8-46e3-8723-51718571cd39 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:46.155452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-847259a7-f1b8-46e3-8723-51718571cd39 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:46.165109 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-847259a7-f1b8-46e3-8723-51718571cd39 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.170318 Jun 16 21:19:46.166222 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 491/1011] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:45 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:46.715260 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5f809a9e-2587-4a0a-bb7d-5e4757c28ed2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:46.716028 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5f809a9e-2587-4a0a-bb7d-5e4757c28ed2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:46.723664 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5f809a9e-2587-4a0a-bb7d-5e4757c28ed2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:46.724110 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5f809a9e-2587-4a0a-bb7d-5e4757c28ed2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:46.724987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5f809a9e-2587-4a0a-bb7d-5e4757c28ed2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:46.725418 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5f809a9e-2587-4a0a-bb7d-5e4757c28ed2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:46.728302 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:46.797602 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a33e2624-91a4-466b-9468-3388433edd86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:46.798264 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a33e2624-91a4-466b-9468-3388433edd86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:46.805089 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a33e2624-91a4-466b-9468-3388433edd86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:46.805545 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a33e2624-91a4-466b-9468-3388433edd86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:46.806327 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a33e2624-91a4-466b-9468-3388433edd86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:46.806764 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a33e2624-91a4-466b-9468-3388433edd86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:46.904970 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5f809a9e-2587-4a0a-bb7d-5e4757c28ed2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:46.913104 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5f809a9e-2587-4a0a-bb7d-5e4757c28ed2 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.203848 Jun 16 21:19:46.913944 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 521/1012] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:46 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:46.965409 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a33e2624-91a4-466b-9468-3388433edd86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:46.973984 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a33e2624-91a4-466b-9468-3388433edd86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:46.975493 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a33e2624-91a4-466b-9468-3388433edd86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:46.976705 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a33e2624-91a4-466b-9468-3388433edd86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.183049 Jun 16 21:19:46.977276 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 492/1013] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:46 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:47.182297 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ccfa0372-9471-4b09-9590-0faaccc53a97 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:47.182862 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ccfa0372-9471-4b09-9590-0faaccc53a97 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:47.188953 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ccfa0372-9471-4b09-9590-0faaccc53a97 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:47.189396 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ccfa0372-9471-4b09-9590-0faaccc53a97 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:47.190283 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ccfa0372-9471-4b09-9590-0faaccc53a97 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:47.190717 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ccfa0372-9471-4b09-9590-0faaccc53a97 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:47.351800 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-ccfa0372-9471-4b09-9590-0faaccc53a97 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:47.359739 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ccfa0372-9471-4b09-9590-0faaccc53a97 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.181262 Jun 16 21:19:47.360440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 522/1014] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:47 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:47.930557 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c19a1e6f-49ee-4474-a15d-1dfab20c77fb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:47.931193 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c19a1e6f-49ee-4474-a15d-1dfab20c77fb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:47.937890 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c19a1e6f-49ee-4474-a15d-1dfab20c77fb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:47.938336 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c19a1e6f-49ee-4474-a15d-1dfab20c77fb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:47.939099 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c19a1e6f-49ee-4474-a15d-1dfab20c77fb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:47.939534 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c19a1e6f-49ee-4474-a15d-1dfab20c77fb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:47.995452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9f6e3cfb-3d17-49be-800a-29523c8a16e2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:47.996130 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-9f6e3cfb-3d17-49be-800a-29523c8a16e2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:48.002869 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9f6e3cfb-3d17-49be-800a-29523c8a16e2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:48.003304 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9f6e3cfb-3d17-49be-800a-29523c8a16e2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:48.004224 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9f6e3cfb-3d17-49be-800a-29523c8a16e2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:48.004720 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9f6e3cfb-3d17-49be-800a-29523c8a16e2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:48.105934 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c19a1e6f-49ee-4474-a15d-1dfab20c77fb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:48.113255 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c19a1e6f-49ee-4474-a15d-1dfab20c77fb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.186597 Jun 16 21:19:48.113848 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 493/1015] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:47 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:48.190430 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9f6e3cfb-3d17-49be-800a-29523c8a16e2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:48.202918 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9f6e3cfb-3d17-49be-800a-29523c8a16e2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:48.205164 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9f6e3cfb-3d17-49be-800a-29523c8a16e2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:48.206997 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9f6e3cfb-3d17-49be-800a-29523c8a16e2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.215708 Jun 16 21:19:48.208978 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 523/1016] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:47 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:19:48.378102 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2368fb0d-925c-4c2c-b373-09c5496110c5 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:48.378855 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2368fb0d-925c-4c2c-b373-09c5496110c5 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:48.387859 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2368fb0d-925c-4c2c-b373-09c5496110c5 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:48.388424 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2368fb0d-925c-4c2c-b373-09c5496110c5 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:48.389510 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2368fb0d-925c-4c2c-b373-09c5496110c5 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:48.390189 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2368fb0d-925c-4c2c-b373-09c5496110c5 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:48.587708 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2368fb0d-925c-4c2c-b373-09c5496110c5 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:48.599803 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2368fb0d-925c-4c2c-b373-09c5496110c5 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.225100 Jun 16 21:19:48.600741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 494/1017] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:48 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:49.131397 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-cba55681-9f18-46a8-8259-f4a42f4fa904 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:49.132012 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-cba55681-9f18-46a8-8259-f4a42f4fa904 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:49.138529 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cba55681-9f18-46a8-8259-f4a42f4fa904 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:49.138913 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cba55681-9f18-46a8-8259-f4a42f4fa904 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:49.139675 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cba55681-9f18-46a8-8259-f4a42f4fa904 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:49.140288 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cba55681-9f18-46a8-8259-f4a42f4fa904 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:49.228239 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-98929308-367a-41e2-8624-2b9070ff69ed tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:49.228843 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-98929308-367a-41e2-8624-2b9070ff69ed tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:49.235389 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-98929308-367a-41e2-8624-2b9070ff69ed tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:49.235827 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-98929308-367a-41e2-8624-2b9070ff69ed tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:49.236620 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-98929308-367a-41e2-8624-2b9070ff69ed tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:49.237046 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-98929308-367a-41e2-8624-2b9070ff69ed tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:49.272778 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-cba55681-9f18-46a8-8259-f4a42f4fa904 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:49.280796 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-cba55681-9f18-46a8-8259-f4a42f4fa904 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.153384 Jun 16 21:19:49.281386 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 524/1018] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:49 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:49.369764 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-98929308-367a-41e2-8624-2b9070ff69ed tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:49.377778 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-98929308-367a-41e2-8624-2b9070ff69ed tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:49.379416 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-98929308-367a-41e2-8624-2b9070ff69ed tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:49.380653 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-98929308-367a-41e2-8624-2b9070ff69ed tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.156446 Jun 16 21:19:49.381220 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 495/1019] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:49 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:19:49.622154 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-96f3d256-bb65-465b-83a9-92184cb4acb7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:49.622761 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-96f3d256-bb65-465b-83a9-92184cb4acb7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:49.628860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-96f3d256-bb65-465b-83a9-92184cb4acb7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:49.630362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-96f3d256-bb65-465b-83a9-92184cb4acb7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:49.631123 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-96f3d256-bb65-465b-83a9-92184cb4acb7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:49.631554 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-96f3d256-bb65-465b-83a9-92184cb4acb7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:49.764426 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-96f3d256-bb65-465b-83a9-92184cb4acb7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:49.772507 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-96f3d256-bb65-465b-83a9-92184cb4acb7 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.154489 Jun 16 21:19:49.773070 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 525/1020] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:49 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:50.298564 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9263a406-0a74-4821-82be-eef7085340cb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:50.299183 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-9263a406-0a74-4821-82be-eef7085340cb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:50.306200 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9263a406-0a74-4821-82be-eef7085340cb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:50.306673 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9263a406-0a74-4821-82be-eef7085340cb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:50.307445 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9263a406-0a74-4821-82be-eef7085340cb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:50.307883 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9263a406-0a74-4821-82be-eef7085340cb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:50.399096 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f0e1cfa3-fcdd-4340-af2b-544577e5dce4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:50.399790 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f0e1cfa3-fcdd-4340-af2b-544577e5dce4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:50.406214 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f0e1cfa3-fcdd-4340-af2b-544577e5dce4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:50.406723 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f0e1cfa3-fcdd-4340-af2b-544577e5dce4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:50.407547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f0e1cfa3-fcdd-4340-af2b-544577e5dce4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:50.408041 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f0e1cfa3-fcdd-4340-af2b-544577e5dce4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:50.543560 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f0e1cfa3-fcdd-4340-af2b-544577e5dce4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:50.545692 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9263a406-0a74-4821-82be-eef7085340cb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:50.553120 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f0e1cfa3-fcdd-4340-af2b-544577e5dce4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:50.554441 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-9263a406-0a74-4821-82be-eef7085340cb tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1522 microversion: 2.1 time: 0.259632 Jun 16 21:19:50.554827 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f0e1cfa3-fcdd-4340-af2b-544577e5dce4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:50.555345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 496/1021] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:50 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:50.556225 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f0e1cfa3-fcdd-4340-af2b-544577e5dce4 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.161142 Jun 16 21:19:50.556770 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 526/1022] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:50 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:19:50.790325 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8041ad6f-8139-4a77-a670-b6035ae1a417 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:50.791039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8041ad6f-8139-4a77-a670-b6035ae1a417 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:50.797481 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8041ad6f-8139-4a77-a670-b6035ae1a417 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:50.798005 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8041ad6f-8139-4a77-a670-b6035ae1a417 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:50.798874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8041ad6f-8139-4a77-a670-b6035ae1a417 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:50.799379 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8041ad6f-8139-4a77-a670-b6035ae1a417 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:50.815490 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=100 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:50.828563 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-10417177-4262-4f9d-913e-873657fed6f9 req-a312f4c2-4f8d-4af3-b7e0-19ed2e9269f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "633275c9-cc8b-4860-b701-2085f7323773", "name": "network-vif-deleted", "tag": "362ac5b6-b908-494d-a8dc-1f18ad69384a"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:19:50.837572 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-10417177-4262-4f9d-913e-873657fed6f9 req-a312f4c2-4f8d-4af3-b7e0-19ed2e9269f5 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:50.838014 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-10417177-4262-4f9d-913e-873657fed6f9 req-a312f4c2-4f8d-4af3-b7e0-19ed2e9269f5 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:50.849109 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-10417177-4262-4f9d-913e-873657fed6f9 req-a312f4c2-4f8d-4af3-b7e0-19ed2e9269f5 service nova] Creating event network-vif-deleted:362ac5b6-b908-494d-a8dc-1f18ad69384a for instance 633275c9-cc8b-4860-b701-2085f7323773 on hv-cinder-81914 Jun 16 21:19:50.854239 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-10417177-4262-4f9d-913e-873657fed6f9 req-a312f4c2-4f8d-4af3-b7e0-19ed2e9269f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029332 Jun 16 21:19:50.854839 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 527/1023] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:19:50.940228 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8041ad6f-8139-4a77-a670-b6035ae1a417 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:50.948382 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8041ad6f-8139-4a77-a670-b6035ae1a417 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.162777 Jun 16 21:19:50.948947 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 497/1024] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:50 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:19:51.520122 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8bc20565-948e-4d85-98f2-f011c87b9f67 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:51.520834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8bc20565-948e-4d85-98f2-f011c87b9f67 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:51.526998 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8bc20565-948e-4d85-98f2-f011c87b9f67 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:51.527443 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8bc20565-948e-4d85-98f2-f011c87b9f67 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:51.528233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8bc20565-948e-4d85-98f2-f011c87b9f67 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:51.528671 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8bc20565-948e-4d85-98f2-f011c87b9f67 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:51.551473 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8bc20565-948e-4d85-98f2-f011c87b9f67 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/ips" status: 200 len: 146 microversion: 2.1 time: 0.035705 Jun 16 21:19:51.556364 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 528/1025] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 16 21:19:51 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:19:51.574043 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4e18b83d-3782-41f6-9cbb-1f2cfd0a2087 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:51.575441 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4e18b83d-3782-41f6-9cbb-1f2cfd0a2087 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:51.577437 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f9c233ae-208b-4ee6-8aaf-7406fe9693d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:51.578050 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f9c233ae-208b-4ee6-8aaf-7406fe9693d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:51.584637 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4e18b83d-3782-41f6-9cbb-1f2cfd0a2087 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:51.585449 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4e18b83d-3782-41f6-9cbb-1f2cfd0a2087 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:51.586522 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4e18b83d-3782-41f6-9cbb-1f2cfd0a2087 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:51.587269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4e18b83d-3782-41f6-9cbb-1f2cfd0a2087 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:51.588942 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f9c233ae-208b-4ee6-8aaf-7406fe9693d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:51.589900 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f9c233ae-208b-4ee6-8aaf-7406fe9693d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:51.595526 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f9c233ae-208b-4ee6-8aaf-7406fe9693d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:51.595526 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f9c233ae-208b-4ee6-8aaf-7406fe9693d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:51.688066 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:51.694665 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4e18b83d-3782-41f6-9cbb-1f2cfd0a2087 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:51.695145 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4e18b83d-3782-41f6-9cbb-1f2cfd0a2087 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:51.695612 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.objects.instance [None req-4e18b83d-3782-41f6-9cbb-1f2cfd0a2087 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lazy-loading 'fault' on Instance uuid 633275c9-cc8b-4860-b701-2085f7323773 {{(pid=117738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:19:51.765162 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4e18b83d-3782-41f6-9cbb-1f2cfd0a2087 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d410832e6584828875128e31baa0ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b341c2d77764f3890f2501cfc6945a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:51.775670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4e18b83d-3782-41f6-9cbb-1f2cfd0a2087 tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 200 len: 1312 microversion: 2.1 time: 0.208637 Jun 16 21:19:51.776723 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 498/1026] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:51 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 1312 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:51.869523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f9c233ae-208b-4ee6-8aaf-7406fe9693d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:51.878113 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f9c233ae-208b-4ee6-8aaf-7406fe9693d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:51.880371 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f9c233ae-208b-4ee6-8aaf-7406fe9693d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:51.882166 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f9c233ae-208b-4ee6-8aaf-7406fe9693d2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.308844 Jun 16 21:19:51.883169 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 529/1027] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:51 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:19:51.965725 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-e1edfa57-1ed1-4267-b6aa-6b08764be092 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:51.966438 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-e1edfa57-1ed1-4267-b6aa-6b08764be092 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:51.972670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e1edfa57-1ed1-4267-b6aa-6b08764be092 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:51.973167 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e1edfa57-1ed1-4267-b6aa-6b08764be092 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:51.973993 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e1edfa57-1ed1-4267-b6aa-6b08764be092 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:51.974427 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e1edfa57-1ed1-4267-b6aa-6b08764be092 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:52.215590 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-e1edfa57-1ed1-4267-b6aa-6b08764be092 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '850e2609986546f68540aec652d1cd9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868add8c6114cc2a3933d63b2e5652a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:52.224028 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-e1edfa57-1ed1-4267-b6aa-6b08764be092 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 200 len: 1566 microversion: 2.1 time: 0.262227 Jun 16 21:19:52.224683 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 499/1028] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:51 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 1566 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:52.517724 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d01d9973-b1db-4156-9021-0663bb43332a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:52.518391 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d01d9973-b1db-4156-9021-0663bb43332a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:52.525566 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d01d9973-b1db-4156-9021-0663bb43332a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:52.526248 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d01d9973-b1db-4156-9021-0663bb43332a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:52.526870 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d01d9973-b1db-4156-9021-0663bb43332a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:52.527281 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d01d9973-b1db-4156-9021-0663bb43332a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:52.623999 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.objects.instance [None req-d01d9973-b1db-4156-9021-0663bb43332a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lazy-loading 'services' on Instance uuid 99b46c41-400a-4a80-9bcf-d07fcfd34a18 {{(pid=117737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:19:52.696765 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d01d9973-b1db-4156-9021-0663bb43332a tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "DELETE /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18/os-volume_attachments/db0b7c92-e177-452b-9933-9a23e7f765ea" status: 202 len: 0 microversion: 2.1 time: 0.182879 Jun 16 21:19:52.697359 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 530/1029] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 16 21:19:52 2022] DELETE /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18/os-volume_attachments/db0b7c92-e177-452b-9933-9a23e7f765ea => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:19:52.706270 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-e31e4b0a-9360-4391-971e-b592132edcee tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:52.707971 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-e31e4b0a-9360-4391-971e-b592132edcee tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:52.714640 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e31e4b0a-9360-4391-971e-b592132edcee tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:52.715165 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e31e4b0a-9360-4391-971e-b592132edcee tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:52.715935 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e31e4b0a-9360-4391-971e-b592132edcee tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:52.716403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-e31e4b0a-9360-4391-971e-b592132edcee tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:52.746109 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-e31e4b0a-9360-4391-971e-b592132edcee tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043759 Jun 16 21:19:52.746668 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 500/1030] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:19:52 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:19:52.792868 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-defe14a5-bd66-454c-ae24-3782d5e04b8a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:52.793559 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-defe14a5-bd66-454c-ae24-3782d5e04b8a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] [instance: 633275c9-cc8b-4860-b701-2085f7323773] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:52.799796 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-defe14a5-bd66-454c-ae24-3782d5e04b8a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:52.800330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-defe14a5-bd66-454c-ae24-3782d5e04b8a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:52.801201 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-defe14a5-bd66-454c-ae24-3782d5e04b8a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:52.801629 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-defe14a5-bd66-454c-ae24-3782d5e04b8a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:52.814892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-defe14a5-bd66-454c-ae24-3782d5e04b8a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] HTTP exception thrown: Instance 633275c9-cc8b-4860-b701-2085f7323773 could not be found. Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-defe14a5-bd66-454c-ae24-3782d5e04b8a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Request method failure captured: Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 HTTP/1.1 Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq507epJ_aTadF1Dd3rdHpBGlGRf4wX2wIMRrVEIy3GJv1cGUncdSTggT3o9d1eY2ow3SkuABL36GC1u31rXJx0UKPHWR1fNJBZP9pTZGMEU61bDRMu4A9RHCrRkLu91ThMUkD7yCVbJCHJ74gAcATick2BtzDKets9fD-77KD88q3xc Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 6b341c2d77764f3890f2501cfc6945a7 Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-273390268 Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:19:52.817046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:19:52.818904 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b341c2d77764f3890f2501cfc6945a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6b341c2d77764f3890f2501cfc6945a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b341c2d77764f3890f2501cfc6945a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6b341c2d77764f3890f2501cfc6945a7"}]}] Jun 16 21:19:52.818904 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-ServerRescueNegativeTestJSON-273390268 Jun 16 21:19:52.818904 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 6b341c2d77764f3890f2501cfc6945a7 Jun 16 21:19:52.818904 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-273390268 Jun 16 21:19:52.818904 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-ServerRescueNegativeTestJSON-273390268-project Jun 16 21:19:52.818904 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:19:52.818904 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:19:52.818904 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 1d410832e6584828875128e31baa0ae8 Jun 16 21:19:52.818904 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-ServerRescueNegativeTestJSON-273390268-project Jun 16 21:19:52.818904 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:19:52.818904 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 633275c9-cc8b-4860-b701-2085f7323773 could not be found. Jun 16 21:19:52.818904 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '633275c9-cc8b-4860-b701-2085f7323773'} Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 633275c9-cc8b-4860-b701-2085f7323773 could not be found. Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:19:52.819834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 633275c9-cc8b-4860-b701-2085f7323773 could not be found. Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 633275c9-cc8b-4860-b701-2085f7323773 could not be found. Jun 16 21:19:52.821330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:19:52.822716 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-defe14a5-bd66-454c-ae24-3782d5e04b8a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] Returning 404 to user: Instance 633275c9-cc8b-4860-b701-2085f7323773 could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:19:52.822716 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-defe14a5-bd66-454c-ae24-3782d5e04b8a tempest-ServerRescueNegativeTestJSON-273390268 tempest-ServerRescueNegativeTestJSON-273390268-project] 10.222.0.43 "GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773" status: 404 len: 111 microversion: 2.1 time: 0.029922 Jun 16 21:19:52.822716 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 531/1031] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:52 2022] GET /compute/v2.1/servers/633275c9-cc8b-4860-b701-2085f7323773 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:19:52.879820 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-75ddc2f5-25d4-443e-8aff-1cbf0b09e44b req-08914166-790c-419b-9873-a01cafd7ec14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329313fc-d559-41c6-9dad-471e57c9751e", "name": "network-vif-deleted", "tag": "dbb3b245-c7c5-45cc-8bc9-e46efbfd90bb"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:19:52.888415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-75ddc2f5-25d4-443e-8aff-1cbf0b09e44b req-08914166-790c-419b-9873-a01cafd7ec14 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:52.888853 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-75ddc2f5-25d4-443e-8aff-1cbf0b09e44b req-08914166-790c-419b-9873-a01cafd7ec14 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:52.901255 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-75ddc2f5-25d4-443e-8aff-1cbf0b09e44b req-08914166-790c-419b-9873-a01cafd7ec14 service nova] Creating event network-vif-deleted:dbb3b245-c7c5-45cc-8bc9-e46efbfd90bb for instance 329313fc-d559-41c6-9dad-471e57c9751e on hv-cinder-81914 Jun 16 21:19:52.902010 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-586d44b9-a011-4119-af15-0bb060631064 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:52.902617 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-586d44b9-a011-4119-af15-0bb060631064 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:52.907190 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-75ddc2f5-25d4-443e-8aff-1cbf0b09e44b req-08914166-790c-419b-9873-a01cafd7ec14 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031056 Jun 16 21:19:52.907678 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 501/1032] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:19:52.909963 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-586d44b9-a011-4119-af15-0bb060631064 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:52.910555 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-586d44b9-a011-4119-af15-0bb060631064 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:52.911286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-586d44b9-a011-4119-af15-0bb060631064 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:52.911720 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-586d44b9-a011-4119-af15-0bb060631064 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:53.005822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-14d53ba5-f5bd-44ae-98d9-705b3d28e849 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b8e7b89-cbe5-4ed3-b3d2-c9b8a2064a77"}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:19:53.010226 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-14d53ba5-f5bd-44ae-98d9-705b3d28e849 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:53.018941 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-14d53ba5-f5bd-44ae-98d9-705b3d28e849 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:53.020339 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-14d53ba5-f5bd-44ae-98d9-705b3d28e849 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:53.021436 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-14d53ba5-f5bd-44ae-98d9-705b3d28e849 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:53.022300 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-14d53ba5-f5bd-44ae-98d9-705b3d28e849 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:53.185118 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-586d44b9-a011-4119-af15-0bb060631064 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:53.193227 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-586d44b9-a011-4119-af15-0bb060631064 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:53.194711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-586d44b9-a011-4119-af15-0bb060631064 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:53.195866 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-586d44b9-a011-4119-af15-0bb060631064 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.298459 Jun 16 21:19:53.196438 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 532/1033] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:52 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:53.240920 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0b4ac987-1c89-417b-9b5e-e0a5b04183a4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:53.241525 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0b4ac987-1c89-417b-9b5e-e0a5b04183a4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] [instance: 329313fc-d559-41c6-9dad-471e57c9751e] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:53.247664 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0b4ac987-1c89-417b-9b5e-e0a5b04183a4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:53.248098 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0b4ac987-1c89-417b-9b5e-e0a5b04183a4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:53.248879 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0b4ac987-1c89-417b-9b5e-e0a5b04183a4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:53.249307 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0b4ac987-1c89-417b-9b5e-e0a5b04183a4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:53.262471 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-0b4ac987-1c89-417b-9b5e-e0a5b04183a4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] HTTP exception thrown: Instance 329313fc-d559-41c6-9dad-471e57c9751e could not be found. Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0b4ac987-1c89-417b-9b5e-e0a5b04183a4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Request method failure captured: Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e HTTP/1.1 Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq50RUHC7JsNc9seqYj4sNA0yltcW1RIu05AGY-7A2AN2sCihq2IV3t6i6lRLx-e3CbxHIat0vx3E8tNJMwMcXU2z3fhqq1o5TsC14rf5_IDyRZKWmqfNMsjApGSzy3zpuYw1LFBZxFNIkqqiEzTyTi7UEncw6hxYJBtjuH7MyrFTxpY Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 9868add8c6114cc2a3933d63b2e5652a Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-TestShelveInstance-122918742 Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:19:53.263987 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:19:53.265663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9868add8c6114cc2a3933d63b2e5652a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9868add8c6114cc2a3933d63b2e5652a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9868add8c6114cc2a3933d63b2e5652a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9868add8c6114cc2a3933d63b2e5652a"}]}] Jun 16 21:19:53.265663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-TestShelveInstance-122918742 Jun 16 21:19:53.265663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 9868add8c6114cc2a3933d63b2e5652a Jun 16 21:19:53.265663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-TestShelveInstance-122918742 Jun 16 21:19:53.265663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-TestShelveInstance-122918742-project Jun 16 21:19:53.265663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:19:53.265663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:19:53.265663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 850e2609986546f68540aec652d1cd9f Jun 16 21:19:53.265663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-TestShelveInstance-122918742-project Jun 16 21:19:53.265663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:19:53.265663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 329313fc-d559-41c6-9dad-471e57c9751e could not be found. Jun 16 21:19:53.265663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '329313fc-d559-41c6-9dad-471e57c9751e'} Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 329313fc-d559-41c6-9dad-471e57c9751e could not be found. Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:19:53.266519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 329313fc-d559-41c6-9dad-471e57c9751e could not be found. Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 329313fc-d559-41c6-9dad-471e57c9751e could not be found. Jun 16 21:19:53.267709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:19:53.268844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0b4ac987-1c89-417b-9b5e-e0a5b04183a4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Returning 404 to user: Instance 329313fc-d559-41c6-9dad-471e57c9751e could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:19:53.268844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0b4ac987-1c89-417b-9b5e-e0a5b04183a4 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e" status: 404 len: 111 microversion: 2.1 time: 0.028258 Jun 16 21:19:53.268844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 533/1034] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:53 2022] GET /compute/v2.1/servers/329313fc-d559-41c6-9dad-471e57c9751e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 21:19:53.483357 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e354b58b-653e-4e0f-af4f-67ce47af8b96 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] Calling method '.version_select at 0x7fb3fc1ecb80>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:53.533002 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e354b58b-653e-4e0f-af4f-67ce47af8b96 tempest-TestShelveInstance-122918742 tempest-TestShelveInstance-122918742-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-423531232" status: 202 len: 0 microversion: 2.1 time: 0.055283 Jun 16 21:19:53.533943 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 534/1035] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 16 21:19:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-423531232 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:19:53.537530 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-14d53ba5-f5bd-44ae-98d9-705b3d28e849 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "POST /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.538676 Jun 16 21:19:53.540740 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 502/1036] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 16 21:19:52 2022] POST /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments => generated 194 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:19:53.765217 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-83da3696-2236-4423-a196-bd548f104c77 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:53.766433 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-83da3696-2236-4423-a196-bd548f104c77 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:53.790274 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-83da3696-2236-4423-a196-bd548f104c77 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:53.790734 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-83da3696-2236-4423-a196-bd548f104c77 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:53.791545 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-83da3696-2236-4423-a196-bd548f104c77 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:53.792229 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-83da3696-2236-4423-a196-bd548f104c77 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:53.866752 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-83da3696-2236-4423-a196-bd548f104c77 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108423 Jun 16 21:19:53.883830 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 535/1037] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:19:53 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 21:19:53.964858 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5746abf5-156f-424a-b5d9-80b8229545f5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:53.966089 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5746abf5-156f-424a-b5d9-80b8229545f5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:53.972696 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5746abf5-156f-424a-b5d9-80b8229545f5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:53.974071 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5746abf5-156f-424a-b5d9-80b8229545f5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:53.975024 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5746abf5-156f-424a-b5d9-80b8229545f5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:53.975620 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5746abf5-156f-424a-b5d9-80b8229545f5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:54.002896 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5746abf5-156f-424a-b5d9-80b8229545f5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Going to try to terminate instance {{(pid=117738) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:19:54.095478 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5746abf5-156f-424a-b5d9-80b8229545f5 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "DELETE /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 204 len: 0 microversion: 2.1 time: 0.138765 Jun 16 21:19:54.097093 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 503/1038] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:19:53 2022] DELETE /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:19:54.106931 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-08c3b31a-3451-4bcd-8d82-81e094511d68 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:54.107702 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-08c3b31a-3451-4bcd-8d82-81e094511d68 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:54.114152 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-08c3b31a-3451-4bcd-8d82-81e094511d68 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:54.115026 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-08c3b31a-3451-4bcd-8d82-81e094511d68 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:54.116100 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-08c3b31a-3451-4bcd-8d82-81e094511d68 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:54.116655 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-08c3b31a-3451-4bcd-8d82-81e094511d68 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:54.215543 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-1b20e1b5-3d6b-42f9-bf0d-be0f76706e67 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:54.217124 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-1b20e1b5-3d6b-42f9-bf0d-be0f76706e67 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:54.227606 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1b20e1b5-3d6b-42f9-bf0d-be0f76706e67 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:54.228490 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1b20e1b5-3d6b-42f9-bf0d-be0f76706e67 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:54.230008 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1b20e1b5-3d6b-42f9-bf0d-be0f76706e67 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:54.230674 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-1b20e1b5-3d6b-42f9-bf0d-be0f76706e67 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:54.483227 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-08c3b31a-3451-4bcd-8d82-81e094511d68 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:54.493382 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-08c3b31a-3451-4bcd-8d82-81e094511d68 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1683 microversion: 2.1 time: 0.391358 Jun 16 21:19:54.493949 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 536/1039] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:54 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1683 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:54.548528 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1b20e1b5-3d6b-42f9-bf0d-be0f76706e67 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:54.557772 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1b20e1b5-3d6b-42f9-bf0d-be0f76706e67 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:54.559277 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-1b20e1b5-3d6b-42f9-bf0d-be0f76706e67 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:54.560594 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-1b20e1b5-3d6b-42f9-bf0d-be0f76706e67 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.349708 Jun 16 21:19:54.561150 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 504/1040] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:54 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:55.511253 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-3633e7a9-843e-41d6-bdf9-8a3d76b90eac tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:55.511980 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-3633e7a9-843e-41d6-bdf9-8a3d76b90eac tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:55.518788 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3633e7a9-843e-41d6-bdf9-8a3d76b90eac tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:55.519324 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3633e7a9-843e-41d6-bdf9-8a3d76b90eac tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:55.520311 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3633e7a9-843e-41d6-bdf9-8a3d76b90eac tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:55.520746 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3633e7a9-843e-41d6-bdf9-8a3d76b90eac tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:55.579110 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c7f975d5-ac43-4991-bdd7-865b6dc11b65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:55.579728 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c7f975d5-ac43-4991-bdd7-865b6dc11b65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:55.588922 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c7f975d5-ac43-4991-bdd7-865b6dc11b65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:55.589317 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c7f975d5-ac43-4991-bdd7-865b6dc11b65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:55.590129 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c7f975d5-ac43-4991-bdd7-865b6dc11b65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:55.590600 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c7f975d5-ac43-4991-bdd7-865b6dc11b65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:55.693438 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3633e7a9-843e-41d6-bdf9-8a3d76b90eac tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:55.709663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-3633e7a9-843e-41d6-bdf9-8a3d76b90eac tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1683 microversion: 2.1 time: 0.202081 Jun 16 21:19:55.711305 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 537/1041] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:55 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1683 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:55.788042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-d1838699-87f4-4148-bc86-c816210302b6 req-2988b6f4-3570-48b5-adc3-1ffcf95e37fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1b5610-fa96-44cf-b05b-41a354370d1c", "name": "network-vif-plugged", "status": "completed", "tag": "ce808840-2e04-4b62-89bc-caeba961a739"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:19:55.800688 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-d1838699-87f4-4148-bc86-c816210302b6 req-2988b6f4-3570-48b5-adc3-1ffcf95e37fa service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:55.801832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-d1838699-87f4-4148-bc86-c816210302b6 req-2988b6f4-3570-48b5-adc3-1ffcf95e37fa service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:55.819217 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-d1838699-87f4-4148-bc86-c816210302b6 req-2988b6f4-3570-48b5-adc3-1ffcf95e37fa service nova] Creating event network-vif-plugged:ce808840-2e04-4b62-89bc-caeba961a739 for instance 6a1b5610-fa96-44cf-b05b-41a354370d1c on hv-cinder-81914 Jun 16 21:19:55.825102 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-d1838699-87f4-4148-bc86-c816210302b6 req-2988b6f4-3570-48b5-adc3-1ffcf95e37fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041548 Jun 16 21:19:55.826292 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 538/1042] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:19:55.930493 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c7f975d5-ac43-4991-bdd7-865b6dc11b65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:55.938797 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c7f975d5-ac43-4991-bdd7-865b6dc11b65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:55.940311 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c7f975d5-ac43-4991-bdd7-865b6dc11b65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:55.941476 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c7f975d5-ac43-4991-bdd7-865b6dc11b65 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.366407 Jun 16 21:19:55.943037 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 505/1043] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:55 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:19:56.735603 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-259961fa-2046-466b-837f-0936ab16bcf6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:56.736910 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-259961fa-2046-466b-837f-0936ab16bcf6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:56.750886 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-259961fa-2046-466b-837f-0936ab16bcf6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:56.751669 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-259961fa-2046-466b-837f-0936ab16bcf6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:56.752093 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-259961fa-2046-466b-837f-0936ab16bcf6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:56.757205 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-259961fa-2046-466b-837f-0936ab16bcf6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:56.961909 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-23315358-084d-4ac0-be8b-d77f241ec9ba tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:56.962755 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-23315358-084d-4ac0-be8b-d77f241ec9ba tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:56.977165 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-23315358-084d-4ac0-be8b-d77f241ec9ba tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:56.977798 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-23315358-084d-4ac0-be8b-d77f241ec9ba tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:56.978698 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-23315358-084d-4ac0-be8b-d77f241ec9ba tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:56.980320 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-23315358-084d-4ac0-be8b-d77f241ec9ba tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:57.326279 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-259961fa-2046-466b-837f-0936ab16bcf6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:57.346560 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-259961fa-2046-466b-837f-0936ab16bcf6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1683 microversion: 2.1 time: 0.614315 Jun 16 21:19:57.356451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 539/1044] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:56 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1683 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:57.368264 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-23315358-084d-4ac0-be8b-d77f241ec9ba tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:57.384381 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-23315358-084d-4ac0-be8b-d77f241ec9ba tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:57.390667 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-23315358-084d-4ac0-be8b-d77f241ec9ba tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:57.392242 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-23315358-084d-4ac0-be8b-d77f241ec9ba tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.435656 Jun 16 21:19:57.393314 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 506/1045] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:56 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:19:58.141384 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-f581674d-3b17-4a45-ac6d-934d73078d3e req-e49134e0-af7c-4fb2-a12b-95de5e9b04b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b46c41-400a-4a80-9bcf-d07fcfd34a18", "name": "network-vif-deleted", "tag": "888667cf-09a8-4cc3-8749-acf758b60412"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:19:58.183979 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-f581674d-3b17-4a45-ac6d-934d73078d3e req-e49134e0-af7c-4fb2-a12b-95de5e9b04b1 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:58.184652 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-f581674d-3b17-4a45-ac6d-934d73078d3e req-e49134e0-af7c-4fb2-a12b-95de5e9b04b1 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:58.215934 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-f581674d-3b17-4a45-ac6d-934d73078d3e req-e49134e0-af7c-4fb2-a12b-95de5e9b04b1 service nova] Creating event network-vif-deleted:888667cf-09a8-4cc3-8749-acf758b60412 for instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 on hv-cinder-81914 Jun 16 21:19:58.234058 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-f581674d-3b17-4a45-ac6d-934d73078d3e req-e49134e0-af7c-4fb2-a12b-95de5e9b04b1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097467 Jun 16 21:19:58.234982 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 540/1046] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:19:58.367320 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6085cbe6-b6fc-4e6d-8f31-4ee9d5508a8d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:58.367936 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6085cbe6-b6fc-4e6d-8f31-4ee9d5508a8d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:58.384789 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6085cbe6-b6fc-4e6d-8f31-4ee9d5508a8d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:58.388994 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6085cbe6-b6fc-4e6d-8f31-4ee9d5508a8d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:58.392375 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6085cbe6-b6fc-4e6d-8f31-4ee9d5508a8d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:58.392834 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6085cbe6-b6fc-4e6d-8f31-4ee9d5508a8d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:58.412108 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-03a2f5e5-fb25-4592-9fa6-77c0d5f165d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:58.412879 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-03a2f5e5-fb25-4592-9fa6-77c0d5f165d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:58.431921 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-03a2f5e5-fb25-4592-9fa6-77c0d5f165d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:58.435528 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-03a2f5e5-fb25-4592-9fa6-77c0d5f165d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:58.436449 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-03a2f5e5-fb25-4592-9fa6-77c0d5f165d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:58.438684 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-03a2f5e5-fb25-4592-9fa6-77c0d5f165d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:58.517036 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6085cbe6-b6fc-4e6d-8f31-4ee9d5508a8d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:58.517487 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6085cbe6-b6fc-4e6d-8f31-4ee9d5508a8d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:58.517950 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.objects.instance [None req-6085cbe6-b6fc-4e6d-8f31-4ee9d5508a8d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lazy-loading 'fault' on Instance uuid 99b46c41-400a-4a80-9bcf-d07fcfd34a18 {{(pid=117738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:19:58.640720 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6085cbe6-b6fc-4e6d-8f31-4ee9d5508a8d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb12a51b62c48ba95be62f167b7314e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22cbeb1402848dbb84a5718dca357e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:58.653081 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6085cbe6-b6fc-4e6d-8f31-4ee9d5508a8d tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 200 len: 1331 microversion: 2.1 time: 0.289942 Jun 16 21:19:58.653697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 507/1047] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:58 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 1331 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:19:58.879959 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-03a2f5e5-fb25-4592-9fa6-77c0d5f165d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:58.883284 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:58.900451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-03a2f5e5-fb25-4592-9fa6-77c0d5f165d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:58.904506 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-03a2f5e5-fb25-4592-9fa6-77c0d5f165d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:19:58.905747 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-03a2f5e5-fb25-4592-9fa6-77c0d5f165d3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1729 microversion: 2.20 time: 0.498655 Jun 16 21:19:58.921587 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 541/1048] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:58 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1729 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:19:59.671478 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5b1f9e8f-3449-4904-a6ea-7d5edf4e2fdd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:59.672732 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5b1f9e8f-3449-4904-a6ea-7d5edf4e2fdd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:59.679828 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5b1f9e8f-3449-4904-a6ea-7d5edf4e2fdd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:59.680290 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5b1f9e8f-3449-4904-a6ea-7d5edf4e2fdd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:59.681670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5b1f9e8f-3449-4904-a6ea-7d5edf4e2fdd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:59.682099 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5b1f9e8f-3449-4904-a6ea-7d5edf4e2fdd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:59.699767 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-5b1f9e8f-3449-4904-a6ea-7d5edf4e2fdd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] HTTP exception thrown: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5b1f9e8f-3449-4904-a6ea-7d5edf4e2fdd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Request method failure captured: Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 HTTP/1.1 Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq5znrg1BlivpFkHnanzWccs2prlszc98SqsEUcUzeeIaKSEmJ9fzENTsjOpe5Qk_NQzgYSx59EKzIYY5fjkk4rwfyQQuYnSRsoplrpGBs8lpSHsUHoyoefKGRLOyWSvHcegVce7Q5IbVWJWykg-Seg-ZRUqsFo_eKeCcFzUevqUD7uU Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:19:59.701494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:19:59.703111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f22cbeb1402848dbb84a5718dca357e1"}]}] Jun 16 21:19:59.703111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:19:59.703111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:19:59.703111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:19:59.703111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:19:59.703111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:19:59.703111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:19:59.703111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 2cb12a51b62c48ba95be62f167b7314e Jun 16 21:19:59.703111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:19:59.703111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:19:59.703111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. Jun 16 21:19:59.703111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '99b46c41-400a-4a80-9bcf-d07fcfd34a18'} Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:19:59.704048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. Jun 16 21:19:59.705576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:19:59.707285 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5b1f9e8f-3449-4904-a6ea-7d5edf4e2fdd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Returning 404 to user: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:19:59.707285 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5b1f9e8f-3449-4904-a6ea-7d5edf4e2fdd tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 404 len: 111 microversion: 2.1 time: 0.035538 Jun 16 21:19:59.707285 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 508/1049] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:19:59 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:19:59.714855 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ef71ae9b-5343-4df1-9313-758a4e2aa88f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '.version_select at 0x7fb3fc11cdc0>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:59.740454 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ef71ae9b-5343-4df1-9313-758a4e2aa88f tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768816861" status: 202 len: 0 microversion: 2.1 time: 0.031406 Jun 16 21:19:59.740951 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 542/1050] 10.222.0.43 () {58 vars in 1220 bytes} [Thu Jun 16 21:19:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768816861 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:19:59.930433 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-52667849-d9cb-4a22-8276-823fc2b9c899 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:19:59.931051 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-52667849-d9cb-4a22-8276-823fc2b9c899 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:19:59.940020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-52667849-d9cb-4a22-8276-823fc2b9c899 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:59.940714 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-52667849-d9cb-4a22-8276-823fc2b9c899 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:19:59.941507 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-52667849-d9cb-4a22-8276-823fc2b9c899 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:19:59.942104 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-52667849-d9cb-4a22-8276-823fc2b9c899 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:00.212963 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-52667849-d9cb-4a22-8276-823fc2b9c899 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:00.224115 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-52667849-d9cb-4a22-8276-823fc2b9c899 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:00.225640 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-52667849-d9cb-4a22-8276-823fc2b9c899 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:00.226815 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-52667849-d9cb-4a22-8276-823fc2b9c899 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1716 microversion: 2.20 time: 0.304177 Jun 16 21:20:00.231711 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 509/1051] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:19:59 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1716 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:20:01.867180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8bc41eb1-f5fb-4158-ae0f-a3a01019c5d7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:01.870625 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8bc41eb1-f5fb-4158-ae0f-a3a01019c5d7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:01.896439 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8bc41eb1-f5fb-4158-ae0f-a3a01019c5d7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:01.897301 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8bc41eb1-f5fb-4158-ae0f-a3a01019c5d7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:01.898131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8bc41eb1-f5fb-4158-ae0f-a3a01019c5d7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:01.898572 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8bc41eb1-f5fb-4158-ae0f-a3a01019c5d7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:01.921631 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-8bc41eb1-f5fb-4158-ae0f-a3a01019c5d7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] HTTP exception thrown: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8bc41eb1-f5fb-4158-ae0f-a3a01019c5d7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Request method failure captured: Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: DELETE /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 HTTP/1.1 Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5znrg1BlivpFkHnanzWccs2prlszc98SqsEUcUzeeIaKSEmJ9fzENTsjOpe5Qk_NQzgYSx59EKzIYY5fjkk4rwfyQQuYnSRsoplrpGBs8lpSHsUHoyoefKGRLOyWSvHcegVce7Q5IbVWJWykg-Seg-ZRUqsFo_eKeCcFzUevqUD7uU Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:20:01.923567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:20:01.925189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f22cbeb1402848dbb84a5718dca357e1"}]}] Jun 16 21:20:01.925189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:01.925189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:20:01.925189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:01.925189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:20:01.925189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:20:01.925189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:20:01.925189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 2cb12a51b62c48ba95be62f167b7314e Jun 16 21:20:01.925189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:20:01.925189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:20:01.925189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. Jun 16 21:20:01.925189 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '99b46c41-400a-4a80-9bcf-d07fcfd34a18'} Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:01.926687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. Jun 16 21:20:01.932679 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:01.934004 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8bc41eb1-f5fb-4158-ae0f-a3a01019c5d7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Returning 404 to user: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:01.934004 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8bc41eb1-f5fb-4158-ae0f-a3a01019c5d7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "DELETE /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 404 len: 111 microversion: 2.1 time: 0.066480 Jun 16 21:20:01.934004 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 543/1052] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:20:01 2022] DELETE /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 21:20:01.939665 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0fa168f8-3b75-4cfc-88d6-94c2b0514397 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:01.941047 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0fa168f8-3b75-4cfc-88d6-94c2b0514397 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 99b46c41-400a-4a80-9bcf-d07fcfd34a18] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:01.949297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0fa168f8-3b75-4cfc-88d6-94c2b0514397 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:01.950105 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0fa168f8-3b75-4cfc-88d6-94c2b0514397 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:01.951105 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0fa168f8-3b75-4cfc-88d6-94c2b0514397 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:01.951839 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0fa168f8-3b75-4cfc-88d6-94c2b0514397 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:01.976431 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-0fa168f8-3b75-4cfc-88d6-94c2b0514397 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] HTTP exception thrown: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0fa168f8-3b75-4cfc-88d6-94c2b0514397 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Request method failure captured: Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 HTTP/1.1 Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq5znrg1BlivpFkHnanzWccs2prlszc98SqsEUcUzeeIaKSEmJ9fzENTsjOpe5Qk_NQzgYSx59EKzIYY5fjkk4rwfyQQuYnSRsoplrpGBs8lpSHsUHoyoefKGRLOyWSvHcegVce7Q5IbVWJWykg-Seg-ZRUqsFo_eKeCcFzUevqUD7uU Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:20:01.981230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:20:01.982697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f22cbeb1402848dbb84a5718dca357e1"}]}] Jun 16 21:20:01.982697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:01.982697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:20:01.982697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:01.982697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:20:01.982697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:20:01.982697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:20:01.982697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 2cb12a51b62c48ba95be62f167b7314e Jun 16 21:20:01.982697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:20:01.982697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:20:01.982697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. Jun 16 21:20:01.982697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '99b46c41-400a-4a80-9bcf-d07fcfd34a18'} Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:01.983495 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. Jun 16 21:20:01.984697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:01.986128 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0fa168f8-3b75-4cfc-88d6-94c2b0514397 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Returning 404 to user: Instance 99b46c41-400a-4a80-9bcf-d07fcfd34a18 could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:01.987623 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0fa168f8-3b75-4cfc-88d6-94c2b0514397 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18" status: 404 len: 111 microversion: 2.1 time: 0.052248 Jun 16 21:20:01.995917 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 510/1053] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:01 2022] GET /compute/v2.1/servers/99b46c41-400a-4a80-9bcf-d07fcfd34a18 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:20:02.307789 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-67894de5-f113-4af8-ab93-6a4e655d14cd tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:02.308972 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-67894de5-f113-4af8-ab93-6a4e655d14cd tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:02.318347 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-67894de5-f113-4af8-ab93-6a4e655d14cd tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:02.318787 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-67894de5-f113-4af8-ab93-6a4e655d14cd tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:02.319705 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-67894de5-f113-4af8-ab93-6a4e655d14cd tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:02.320135 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-67894de5-f113-4af8-ab93-6a4e655d14cd tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:02.354251 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-67894de5-f113-4af8-ab93-6a4e655d14cd tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051852 Jun 16 21:20:02.355626 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 544/1054] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:20:02 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:20:02.369112 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-89368c88-3222-4432-baf0-f9cc075e81cf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:02.369922 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-89368c88-3222-4432-baf0-f9cc075e81cf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:02.377510 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-89368c88-3222-4432-baf0-f9cc075e81cf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:02.377966 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-89368c88-3222-4432-baf0-f9cc075e81cf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:02.378741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-89368c88-3222-4432-baf0-f9cc075e81cf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:02.379843 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-89368c88-3222-4432-baf0-f9cc075e81cf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:02.418457 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-89368c88-3222-4432-baf0-f9cc075e81cf tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments/8b8e7b89-cbe5-4ed3-b3d2-c9b8a2064a77" status: 200 len: 194 microversion: 2.1 time: 0.053602 Jun 16 21:20:02.419565 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 511/1055] 10.222.0.43 () {58 vars in 1412 bytes} [Thu Jun 16 21:20:02 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments/8b8e7b89-cbe5-4ed3-b3d2-c9b8a2064a77 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:20:03.175951 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-548dee5f-3e48-40aa-a00b-0f2a50570ae7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:03.177172 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-548dee5f-3e48-40aa-a00b-0f2a50570ae7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:03.183636 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-548dee5f-3e48-40aa-a00b-0f2a50570ae7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:03.184087 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-548dee5f-3e48-40aa-a00b-0f2a50570ae7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:03.184904 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-548dee5f-3e48-40aa-a00b-0f2a50570ae7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:03.185338 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-548dee5f-3e48-40aa-a00b-0f2a50570ae7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:03.198880 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-548dee5f-3e48-40aa-a00b-0f2a50570ae7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] HTTP exception thrown: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-548dee5f-3e48-40aa-a00b-0f2a50570ae7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Request method failure captured: Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: DELETE /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba HTTP/1.1 Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5znrg1BlivpFkHnanzWccs2prlszc98SqsEUcUzeeIaKSEmJ9fzENTsjOpe5Qk_NQzgYSx59EKzIYY5fjkk4rwfyQQuYnSRsoplrpGBs8lpSHsUHoyoefKGRLOyWSvHcegVce7Q5IbVWJWykg-Seg-ZRUqsFo_eKeCcFzUevqUD7uU Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:20:03.200478 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:20:03.202023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f22cbeb1402848dbb84a5718dca357e1"}]}] Jun 16 21:20:03.202023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:03.202023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:20:03.202023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:03.202023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:20:03.202023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:20:03.202023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:20:03.202023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 2cb12a51b62c48ba95be62f167b7314e Jun 16 21:20:03.202023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:20:03.202023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:20:03.202023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. Jun 16 21:20:03.202023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '5ea6b530-d41f-4b72-af93-e2cdb36addba'} Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:03.202797 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. Jun 16 21:20:03.204001 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.205218 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-548dee5f-3e48-40aa-a00b-0f2a50570ae7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Returning 404 to user: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:03.205218 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-548dee5f-3e48-40aa-a00b-0f2a50570ae7 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 404 len: 111 microversion: 2.1 time: 0.030036 Jun 16 21:20:03.205218 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 545/1056] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:20:03 2022] DELETE /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:20:03.210981 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5e67ee77-c548-4ab5-b384-040651279335 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:03.211602 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5e67ee77-c548-4ab5-b384-040651279335 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 5ea6b530-d41f-4b72-af93-e2cdb36addba] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:03.218037 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5e67ee77-c548-4ab5-b384-040651279335 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:03.218482 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5e67ee77-c548-4ab5-b384-040651279335 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:03.219252 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5e67ee77-c548-4ab5-b384-040651279335 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:03.219695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5e67ee77-c548-4ab5-b384-040651279335 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:03.233566 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-5e67ee77-c548-4ab5-b384-040651279335 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] HTTP exception thrown: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5e67ee77-c548-4ab5-b384-040651279335 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Request method failure captured: Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba HTTP/1.1 Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq5znrg1BlivpFkHnanzWccs2prlszc98SqsEUcUzeeIaKSEmJ9fzENTsjOpe5Qk_NQzgYSx59EKzIYY5fjkk4rwfyQQuYnSRsoplrpGBs8lpSHsUHoyoefKGRLOyWSvHcegVce7Q5IbVWJWykg-Seg-ZRUqsFo_eKeCcFzUevqUD7uU Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:20:03.235484 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:20:03.237057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f22cbeb1402848dbb84a5718dca357e1"}]}] Jun 16 21:20:03.237057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:03.237057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:20:03.237057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:03.237057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:20:03.237057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:20:03.237057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:20:03.237057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 2cb12a51b62c48ba95be62f167b7314e Jun 16 21:20:03.237057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:20:03.237057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:20:03.237057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. Jun 16 21:20:03.237057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '5ea6b530-d41f-4b72-af93-e2cdb36addba'} Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:03.237822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. Jun 16 21:20:03.239874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.241618 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5e67ee77-c548-4ab5-b384-040651279335 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Returning 404 to user: Instance 5ea6b530-d41f-4b72-af93-e2cdb36addba could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:03.241618 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5e67ee77-c548-4ab5-b384-040651279335 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba" status: 404 len: 111 microversion: 2.1 time: 0.029968 Jun 16 21:20:03.241618 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 512/1057] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:03 2022] GET /compute/v2.1/servers/5ea6b530-d41f-4b72-af93-e2cdb36addba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:20:03.251016 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-74948ef2-ff79-46f0-a3be-b0aa7a7860cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:03.251602 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-74948ef2-ff79-46f0-a3be-b0aa7a7860cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:03.258132 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-74948ef2-ff79-46f0-a3be-b0aa7a7860cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:03.258583 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-74948ef2-ff79-46f0-a3be-b0aa7a7860cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:03.259607 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-74948ef2-ff79-46f0-a3be-b0aa7a7860cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:03.259832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-74948ef2-ff79-46f0-a3be-b0aa7a7860cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:03.274339 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-74948ef2-ff79-46f0-a3be-b0aa7a7860cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] HTTP exception thrown: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-74948ef2-ff79-46f0-a3be-b0aa7a7860cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Request method failure captured: Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: DELETE /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f HTTP/1.1 Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5znrg1BlivpFkHnanzWccs2prlszc98SqsEUcUzeeIaKSEmJ9fzENTsjOpe5Qk_NQzgYSx59EKzIYY5fjkk4rwfyQQuYnSRsoplrpGBs8lpSHsUHoyoefKGRLOyWSvHcegVce7Q5IbVWJWykg-Seg-ZRUqsFo_eKeCcFzUevqUD7uU Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:20:03.275838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:20:03.278756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f22cbeb1402848dbb84a5718dca357e1"}]}] Jun 16 21:20:03.278756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:03.278756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:20:03.278756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:03.278756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:20:03.278756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:20:03.278756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:20:03.278756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 2cb12a51b62c48ba95be62f167b7314e Jun 16 21:20:03.278756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:20:03.278756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:20:03.278756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. Jun 16 21:20:03.278756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '7fe2c1e9-e3e7-437a-b627-53fa261bfe2f'} Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:03.280685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. Jun 16 21:20:03.284440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.288616 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-74948ef2-ff79-46f0-a3be-b0aa7a7860cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Returning 404 to user: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:03.288616 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-74948ef2-ff79-46f0-a3be-b0aa7a7860cf tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 404 len: 111 microversion: 2.1 time: 0.032673 Jun 16 21:20:03.288616 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 546/1058] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:20:03 2022] DELETE /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:20:03.289394 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a2fe1397-08f3-49f9-93b9-43e2599a0208 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:03.289394 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a2fe1397-08f3-49f9-93b9-43e2599a0208 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:03.293866 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a2fe1397-08f3-49f9-93b9-43e2599a0208 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:03.294630 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a2fe1397-08f3-49f9-93b9-43e2599a0208 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:03.295069 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a2fe1397-08f3-49f9-93b9-43e2599a0208 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:03.295519 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a2fe1397-08f3-49f9-93b9-43e2599a0208 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:03.301653 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:03.312081 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-a2fe1397-08f3-49f9-93b9-43e2599a0208 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] HTTP exception thrown: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a2fe1397-08f3-49f9-93b9-43e2599a0208 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Request method failure captured: Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f HTTP/1.1 Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq5znrg1BlivpFkHnanzWccs2prlszc98SqsEUcUzeeIaKSEmJ9fzENTsjOpe5Qk_NQzgYSx59EKzIYY5fjkk4rwfyQQuYnSRsoplrpGBs8lpSHsUHoyoefKGRLOyWSvHcegVce7Q5IbVWJWykg-Seg-ZRUqsFo_eKeCcFzUevqUD7uU Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:20:03.313516 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:20:03.314960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f22cbeb1402848dbb84a5718dca357e1"}]}] Jun 16 21:20:03.314960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:03.314960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:20:03.314960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:03.314960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:20:03.314960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:20:03.314960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:20:03.314960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 2cb12a51b62c48ba95be62f167b7314e Jun 16 21:20:03.314960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:20:03.314960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:20:03.314960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. Jun 16 21:20:03.314960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '7fe2c1e9-e3e7-437a-b627-53fa261bfe2f'} Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:03.315691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. Jun 16 21:20:03.317952 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:03.319080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a2fe1397-08f3-49f9-93b9-43e2599a0208 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Returning 404 to user: Instance 7fe2c1e9-e3e7-437a-b627-53fa261bfe2f could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:03.319080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a2fe1397-08f3-49f9-93b9-43e2599a0208 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f" status: 404 len: 111 microversion: 2.1 time: 0.032842 Jun 16 21:20:03.319080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 513/1059] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:03 2022] GET /compute/v2.1/servers/7fe2c1e9-e3e7-437a-b627-53fa261bfe2f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:20:03.949375 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b022c228-e634-4690-a490-645e5524486f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ff3a84e-0391-410d-8a6e-a55e2dbf6a85"}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:20:03.950464 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b022c228-e634-4690-a490-645e5524486f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:03.957226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b022c228-e634-4690-a490-645e5524486f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:03.958162 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b022c228-e634-4690-a490-645e5524486f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:03.959097 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b022c228-e634-4690-a490-645e5524486f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:03.959528 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b022c228-e634-4690-a490-645e5524486f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:04.267019 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b022c228-e634-4690-a490-645e5524486f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "POST /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321391 Jun 16 21:20:04.267849 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 547/1060] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 16 21:20:03 2022] POST /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:20:04.487440 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-40687660-aa59-40cc-8359-38000e4b0748 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:04.489089 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-40687660-aa59-40cc-8359-38000e4b0748 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:04.497463 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-40687660-aa59-40cc-8359-38000e4b0748 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:04.498072 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-40687660-aa59-40cc-8359-38000e4b0748 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:04.498860 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-40687660-aa59-40cc-8359-38000e4b0748 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:04.499305 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-40687660-aa59-40cc-8359-38000e4b0748 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:04.514290 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-40687660-aa59-40cc-8359-38000e4b0748 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] HTTP exception thrown: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-40687660-aa59-40cc-8359-38000e4b0748 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Request method failure captured: Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: DELETE /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 HTTP/1.1 Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq5znrg1BlivpFkHnanzWccs2prlszc98SqsEUcUzeeIaKSEmJ9fzENTsjOpe5Qk_NQzgYSx59EKzIYY5fjkk4rwfyQQuYnSRsoplrpGBs8lpSHsUHoyoefKGRLOyWSvHcegVce7Q5IbVWJWykg-Seg-ZRUqsFo_eKeCcFzUevqUD7uU Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:20:04.515849 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:20:04.517250 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f22cbeb1402848dbb84a5718dca357e1"}]}] Jun 16 21:20:04.517250 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:04.517250 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:20:04.517250 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:04.517250 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:20:04.517250 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:20:04.517250 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:20:04.517250 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 2cb12a51b62c48ba95be62f167b7314e Jun 16 21:20:04.517250 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:20:04.517250 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:20:04.517250 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. Jun 16 21:20:04.517250 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '397f70d9-d52e-42e2-9d9c-a5921d7632a0'} Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:04.518020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. Jun 16 21:20:04.519225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:04.522561 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-40687660-aa59-40cc-8359-38000e4b0748 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Returning 404 to user: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:04.522561 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-40687660-aa59-40cc-8359-38000e4b0748 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "DELETE /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 404 len: 111 microversion: 2.1 time: 0.034006 Jun 16 21:20:04.522561 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 514/1061] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:20:04 2022] DELETE /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:20:04.531116 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-2e1006da-6bb0-4f3a-8410-ccc1a299e5a6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:04.532613 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-2e1006da-6bb0-4f3a-8410-ccc1a299e5a6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] [instance: 397f70d9-d52e-42e2-9d9c-a5921d7632a0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:04.536826 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:04.545752 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2e1006da-6bb0-4f3a-8410-ccc1a299e5a6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:04.546522 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2e1006da-6bb0-4f3a-8410-ccc1a299e5a6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:04.547844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2e1006da-6bb0-4f3a-8410-ccc1a299e5a6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:04.548848 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2e1006da-6bb0-4f3a-8410-ccc1a299e5a6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:04.573398 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-2e1006da-6bb0-4f3a-8410-ccc1a299e5a6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] HTTP exception thrown: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-2e1006da-6bb0-4f3a-8410-ccc1a299e5a6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Request method failure captured: Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 HTTP/1.1 Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5znrg1BlivpFkHnanzWccs2prlszc98SqsEUcUzeeIaKSEmJ9fzENTsjOpe5Qk_NQzgYSx59EKzIYY5fjkk4rwfyQQuYnSRsoplrpGBs8lpSHsUHoyoefKGRLOyWSvHcegVce7Q5IbVWJWykg-Seg-ZRUqsFo_eKeCcFzUevqUD7uU Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:20:04.576266 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:20:04.579185 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f22cbeb1402848dbb84a5718dca357e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f22cbeb1402848dbb84a5718dca357e1"}]}] Jun 16 21:20:04.579185 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:04.579185 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: f22cbeb1402848dbb84a5718dca357e1 Jun 16 21:20:04.579185 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412742474 Jun 16 21:20:04.579185 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:20:04.579185 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:20:04.579185 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:20:04.579185 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 2cb12a51b62c48ba95be62f167b7314e Jun 16 21:20:04.579185 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-AttachVolumeNegativeTest-1412742474-project Jun 16 21:20:04.579185 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:20:04.579185 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. Jun 16 21:20:04.579185 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '397f70d9-d52e-42e2-9d9c-a5921d7632a0'} Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:04.581180 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. Jun 16 21:20:04.601711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:04.608762 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-2e1006da-6bb0-4f3a-8410-ccc1a299e5a6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] Returning 404 to user: Instance 397f70d9-d52e-42e2-9d9c-a5921d7632a0 could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:04.608762 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-2e1006da-6bb0-4f3a-8410-ccc1a299e5a6 tempest-AttachVolumeNegativeTest-1412742474 tempest-AttachVolumeNegativeTest-1412742474-project] 10.222.0.43 "GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0" status: 404 len: 111 microversion: 2.1 time: 0.058525 Jun 16 21:20:04.608762 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 548/1062] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:04 2022] GET /compute/v2.1/servers/397f70d9-d52e-42e2-9d9c-a5921d7632a0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:20:12.094968 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c4681335-c3e6-45b3-9eec-eb0a83173628 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:12.095942 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c4681335-c3e6-45b3-9eec-eb0a83173628 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:12.106226 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c4681335-c3e6-45b3-9eec-eb0a83173628 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:12.106975 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c4681335-c3e6-45b3-9eec-eb0a83173628 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:12.107763 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c4681335-c3e6-45b3-9eec-eb0a83173628 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:12.108222 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c4681335-c3e6-45b3-9eec-eb0a83173628 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:12.163367 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c4681335-c3e6-45b3-9eec-eb0a83173628 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.072180 Jun 16 21:20:12.164203 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 515/1063] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:20:12 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:20:12.303860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8e299eeb-a9ef-4210-8374-409c00b52291 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:12.304491 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8e299eeb-a9ef-4210-8374-409c00b52291 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:12.321099 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8e299eeb-a9ef-4210-8374-409c00b52291 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:12.321854 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8e299eeb-a9ef-4210-8374-409c00b52291 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:12.323403 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8e299eeb-a9ef-4210-8374-409c00b52291 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:12.324004 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8e299eeb-a9ef-4210-8374-409c00b52291 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:12.377328 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8e299eeb-a9ef-4210-8374-409c00b52291 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments/8b8e7b89-cbe5-4ed3-b3d2-c9b8a2064a77" status: 200 len: 194 microversion: 2.1 time: 0.078386 Jun 16 21:20:12.378464 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 549/1064] 10.222.0.43 () {58 vars in 1412 bytes} [Thu Jun 16 21:20:12 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments/8b8e7b89-cbe5-4ed3-b3d2-c9b8a2064a77 => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:20:12.389352 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-77d49219-30e9-4239-ae7f-fb144baab3d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:12.389842 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-77d49219-30e9-4239-ae7f-fb144baab3d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:12.397066 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-77d49219-30e9-4239-ae7f-fb144baab3d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:12.397735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-77d49219-30e9-4239-ae7f-fb144baab3d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:12.398665 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-77d49219-30e9-4239-ae7f-fb144baab3d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:12.399094 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-77d49219-30e9-4239-ae7f-fb144baab3d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:12.518766 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.objects.instance [None req-77d49219-30e9-4239-ae7f-fb144baab3d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lazy-loading 'services' on Instance uuid 319ab15e-eeb3-4557-9840-4ebfd759e4b3 {{(pid=117738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:20:12.615073 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-77d49219-30e9-4239-ae7f-fb144baab3d4 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "DELETE /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments/8b8e7b89-cbe5-4ed3-b3d2-c9b8a2064a77" status: 202 len: 0 microversion: 2.1 time: 0.229924 Jun 16 21:20:12.615900 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 516/1065] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 16 21:20:12 2022] DELETE /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments/8b8e7b89-cbe5-4ed3-b3d2-c9b8a2064a77 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:20:13.826661 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9fc82f59-2d48-44d2-bcd7-b21bb2ac5d38 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:13.830480 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-9fc82f59-2d48-44d2-bcd7-b21bb2ac5d38 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:13.840741 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9fc82f59-2d48-44d2-bcd7-b21bb2ac5d38 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:13.842159 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9fc82f59-2d48-44d2-bcd7-b21bb2ac5d38 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:13.843222 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9fc82f59-2d48-44d2-bcd7-b21bb2ac5d38 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:13.844000 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9fc82f59-2d48-44d2-bcd7-b21bb2ac5d38 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:13.881589 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9fc82f59-2d48-44d2-bcd7-b21bb2ac5d38 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments/9ff3a84e-0391-410d-8a6e-a55e2dbf6a85" status: 200 len: 194 microversion: 2.1 time: 0.061214 Jun 16 21:20:13.883281 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 550/1066] 10.222.0.43 () {58 vars in 1412 bytes} [Thu Jun 16 21:20:13 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments/9ff3a84e-0391-410d-8a6e-a55e2dbf6a85 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:20:13.895455 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-f7ae98da-e79c-444d-830f-83985d99c1d2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:13.896376 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-f7ae98da-e79c-444d-830f-83985d99c1d2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:13.909223 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f7ae98da-e79c-444d-830f-83985d99c1d2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:13.909666 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f7ae98da-e79c-444d-830f-83985d99c1d2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:13.912686 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f7ae98da-e79c-444d-830f-83985d99c1d2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:13.913126 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f7ae98da-e79c-444d-830f-83985d99c1d2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:14.036447 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.objects.instance [None req-f7ae98da-e79c-444d-830f-83985d99c1d2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lazy-loading 'services' on Instance uuid 319ab15e-eeb3-4557-9840-4ebfd759e4b3 {{(pid=117738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:20:14.163049 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-f7ae98da-e79c-444d-830f-83985d99c1d2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "DELETE /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments/9ff3a84e-0391-410d-8a6e-a55e2dbf6a85" status: 202 len: 0 microversion: 2.1 time: 0.274000 Jun 16 21:20:14.163651 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 517/1067] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 16 21:20:13 2022] DELETE /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments/9ff3a84e-0391-410d-8a6e-a55e2dbf6a85 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 21:20:15.406631 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-92d9b480-10d5-452b-a867-b87457f705b6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:15.407606 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-92d9b480-10d5-452b-a867-b87457f705b6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:15.414866 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-92d9b480-10d5-452b-a867-b87457f705b6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:15.415314 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-92d9b480-10d5-452b-a867-b87457f705b6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:15.416077 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-92d9b480-10d5-452b-a867-b87457f705b6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:15.420467 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-92d9b480-10d5-452b-a867-b87457f705b6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:15.492776 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-92d9b480-10d5-452b-a867-b87457f705b6 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089847 Jun 16 21:20:15.495688 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 551/1068] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:20:15 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 21:20:15.746320 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-f4e93e4c-7521-40f5-ad74-b6672f3fe39d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:15.750250 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-f4e93e4c-7521-40f5-ad74-b6672f3fe39d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:15.778297 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f4e93e4c-7521-40f5-ad74-b6672f3fe39d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:15.778763 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f4e93e4c-7521-40f5-ad74-b6672f3fe39d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:15.779567 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f4e93e4c-7521-40f5-ad74-b6672f3fe39d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:15.780007 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f4e93e4c-7521-40f5-ad74-b6672f3fe39d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:15.854417 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-f4e93e4c-7521-40f5-ad74-b6672f3fe39d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128001 Jun 16 21:20:15.855005 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 518/1069] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 16 21:20:15 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 21:20:15.935204 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-da53fe1b-8591-431a-b2ed-cf0cc4f87839 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:15.936140 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-da53fe1b-8591-431a-b2ed-cf0cc4f87839 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:15.947242 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-da53fe1b-8591-431a-b2ed-cf0cc4f87839 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:15.947948 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-da53fe1b-8591-431a-b2ed-cf0cc4f87839 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:15.949225 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-da53fe1b-8591-431a-b2ed-cf0cc4f87839 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:15.949854 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-da53fe1b-8591-431a-b2ed-cf0cc4f87839 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:15.996873 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-da53fe1b-8591-431a-b2ed-cf0cc4f87839 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Going to try to terminate instance {{(pid=117737) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:20:16.121916 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-da53fe1b-8591-431a-b2ed-cf0cc4f87839 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "DELETE /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 204 len: 0 microversion: 2.1 time: 0.192823 Jun 16 21:20:16.123228 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 552/1070] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:20:15 2022] DELETE /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:20:16.132332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-18da59f8-6e4b-46d9-9f1a-9d816847cba0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:16.133369 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-18da59f8-6e4b-46d9-9f1a-9d816847cba0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:16.147822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-18da59f8-6e4b-46d9-9f1a-9d816847cba0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:16.148341 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-18da59f8-6e4b-46d9-9f1a-9d816847cba0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:16.149162 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-18da59f8-6e4b-46d9-9f1a-9d816847cba0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:16.149604 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-18da59f8-6e4b-46d9-9f1a-9d816847cba0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:16.386929 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-18da59f8-6e4b-46d9-9f1a-9d816847cba0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:16.401085 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-18da59f8-6e4b-46d9-9f1a-9d816847cba0 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 200 len: 1672 microversion: 2.1 time: 0.273042 Jun 16 21:20:16.402068 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 519/1071] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:16 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 1672 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:17.445546 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-434140da-a9ff-4d6f-8e0b-f6a8ac435759 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:17.446421 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-434140da-a9ff-4d6f-8e0b-f6a8ac435759 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:17.466899 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-434140da-a9ff-4d6f-8e0b-f6a8ac435759 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:17.467550 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-434140da-a9ff-4d6f-8e0b-f6a8ac435759 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:17.470477 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-434140da-a9ff-4d6f-8e0b-f6a8ac435759 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:17.471064 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-434140da-a9ff-4d6f-8e0b-f6a8ac435759 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:17.800570 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-434140da-a9ff-4d6f-8e0b-f6a8ac435759 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:17.816623 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-434140da-a9ff-4d6f-8e0b-f6a8ac435759 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 200 len: 1672 microversion: 2.1 time: 0.387599 Jun 16 21:20:17.828212 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 553/1072] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:17 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 1672 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:18.499098 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c77dbb22-2f5e-49f7-a666-b1a68b35f67e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Action: 'create', calling method: .version_select at 0x7fb3fc0340d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-304404175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2wFU3v2SpyaxhhZpVkRxs8yNyv1KHVyDhx7w+iIvoAxqzHT6fbigaWvwyOZDdT/r65SMDUa4JkS2vOLwCwI9kD13bO+fsxoNB3cQ3dexejlu9IINg5Gu+ZiJFIIxzMZA=="}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:20:18.513874 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-c77dbb22-2f5e-49f7-a666-b1a68b35f67e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Getting quotas for project b568a213302f46fda9ab9467d36996c5. Resources: {'key_pairs'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:20:18.517580 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-c77dbb22-2f5e-49f7-a666-b1a68b35f67e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Getting quotas for user 236f49a4117f488ea8bf5c523fadadc8 and project b568a213302f46fda9ab9467d36996c5. Resources: {'key_pairs'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:20:18.538283 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c77dbb22-2f5e-49f7-a666-b1a68b35f67e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.216745 Jun 16 21:20:18.538898 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 520/1073] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 16 21:20:18 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:20:18.845205 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-6672cdc9-a990-4194-9274-18d4ab0b7f63 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:18.845903 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-6672cdc9-a990-4194-9274-18d4ab0b7f63 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:18.853077 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6672cdc9-a990-4194-9274-18d4ab0b7f63 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:18.853606 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6672cdc9-a990-4194-9274-18d4ab0b7f63 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:18.854414 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6672cdc9-a990-4194-9274-18d4ab0b7f63 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:18.854850 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6672cdc9-a990-4194-9274-18d4ab0b7f63 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:19.056256 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6672cdc9-a990-4194-9274-18d4ab0b7f63 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:19.067888 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-6672cdc9-a990-4194-9274-18d4ab0b7f63 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 200 len: 1672 microversion: 2.1 time: 0.226494 Jun 16 21:20:19.068486 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 554/1074] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:18 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 1672 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:20:20.087614 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-f25925f5-bc8b-4302-8f3b-7447bb03f685 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:20.089120 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-f25925f5-bc8b-4302-8f3b-7447bb03f685 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:20.099246 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f25925f5-bc8b-4302-8f3b-7447bb03f685 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:20.099610 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f25925f5-bc8b-4302-8f3b-7447bb03f685 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:20.100984 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f25925f5-bc8b-4302-8f3b-7447bb03f685 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:20.101604 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f25925f5-bc8b-4302-8f3b-7447bb03f685 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:20.375200 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-f25925f5-bc8b-4302-8f3b-7447bb03f685 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:20.396248 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-f25925f5-bc8b-4302-8f3b-7447bb03f685 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 200 len: 1672 microversion: 2.1 time: 0.314409 Jun 16 21:20:20.396673 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 521/1075] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:20 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 1672 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:21.400206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-a911cb76-8ce5-40dc-a75b-f92ace07ca52 req-7376a468-8dea-4d13-9498-5eb8f2d57063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319ab15e-eeb3-4557-9840-4ebfd759e4b3", "name": "network-vif-deleted", "tag": "dbf06214-e133-43af-b2fc-89ebd0b9c79b"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:20:21.415181 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0d223bb0-082c-4b15-a144-687de3be953a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:21.416518 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0d223bb0-082c-4b15-a144-687de3be953a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:21.434406 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-a911cb76-8ce5-40dc-a75b-f92ace07ca52 req-7376a468-8dea-4d13-9498-5eb8f2d57063 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:21.439076 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0d223bb0-082c-4b15-a144-687de3be953a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:21.444729 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0d223bb0-082c-4b15-a144-687de3be953a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:21.447811 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-a911cb76-8ce5-40dc-a75b-f92ace07ca52 req-7376a468-8dea-4d13-9498-5eb8f2d57063 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:21.448152 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0d223bb0-082c-4b15-a144-687de3be953a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:21.449299 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0d223bb0-082c-4b15-a144-687de3be953a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:21.486313 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-a911cb76-8ce5-40dc-a75b-f92ace07ca52 req-7376a468-8dea-4d13-9498-5eb8f2d57063 service nova] Creating event network-vif-deleted:dbf06214-e133-43af-b2fc-89ebd0b9c79b for instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 on hv-cinder-81914 Jun 16 21:20:21.502710 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-a911cb76-8ce5-40dc-a75b-f92ace07ca52 req-7376a468-8dea-4d13-9498-5eb8f2d57063 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111413 Jun 16 21:20:21.505950 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 555/1076] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:20:21.604829 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0d223bb0-082c-4b15-a144-687de3be953a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c13ce02fca548c5b1186a536a2d4474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536b36bd517a4dca8706718f6bab9c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:21.620490 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0d223bb0-082c-4b15-a144-687de3be953a tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 200 len: 1320 microversion: 2.1 time: 0.209966 Jun 16 21:20:21.621091 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 522/1077] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:21 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 1320 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:20:22.639481 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e5086817-5368-4274-86ef-eeb54f9a6fa2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:22.640881 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e5086817-5368-4274-86ef-eeb54f9a6fa2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:22.648290 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e5086817-5368-4274-86ef-eeb54f9a6fa2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:22.648748 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e5086817-5368-4274-86ef-eeb54f9a6fa2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:22.649535 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e5086817-5368-4274-86ef-eeb54f9a6fa2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:22.649971 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e5086817-5368-4274-86ef-eeb54f9a6fa2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:22.667892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-e5086817-5368-4274-86ef-eeb54f9a6fa2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] HTTP exception thrown: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e5086817-5368-4274-86ef-eeb54f9a6fa2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Request method failure captured: Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 HTTP/1.1 Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5zsa35CtN8XEl75-3NrP_xD-Z7zHpuMyMzYg4Yxg3B_gzLMFcdAmxPm5DKcxX4gVGQP_eQs5f6ZenY30sXHg0t_LqrszxEv-diPFZcjk3dTV-3lU-D9-lJjSrjszv5Hb2y4cKp0JVmzUOvCBRqHC6SXIi044ZiYUoeMQ6oo3fWTG1o Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 536b36bd517a4dca8706718f6bab9c1a Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:20:22.669581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:20:22.671069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/536b36bd517a4dca8706718f6bab9c1a"}]}] Jun 16 21:20:22.671069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:20:22.671069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 536b36bd517a4dca8706718f6bab9c1a Jun 16 21:20:22.671069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:20:22.671069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-AttachVolumeTestJSON-1205751699-project Jun 16 21:20:22.671069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:20:22.671069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:20:22.671069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 9c13ce02fca548c5b1186a536a2d4474 Jun 16 21:20:22.671069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-AttachVolumeTestJSON-1205751699-project Jun 16 21:20:22.671069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:20:22.671069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. Jun 16 21:20:22.671069 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '319ab15e-eeb3-4557-9840-4ebfd759e4b3'} Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:22.671867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. Jun 16 21:20:22.674294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:22.678107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e5086817-5368-4274-86ef-eeb54f9a6fa2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Returning 404 to user: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:22.678107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e5086817-5368-4274-86ef-eeb54f9a6fa2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 404 len: 111 microversion: 2.1 time: 0.037252 Jun 16 21:20:22.678107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 556/1078] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:22 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:20:22.680810 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a177e0e7-46e0-41f9-bc0b-c287ac32c98d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '.version_select at 0x7fb3fc0993a0>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:22.687747 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:22.703949 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a177e0e7-46e0-41f9-bc0b-c287ac32c98d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-482291227" status: 202 len: 0 microversion: 2.1 time: 0.027810 Jun 16 21:20:22.704572 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 523/1079] 10.222.0.43 () {58 vars in 1217 bytes} [Thu Jun 16 21:20:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-482291227 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:20:25.693294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a69b22e7-a2e7-4413-95fd-68872de078b1 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:25.693937 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a69b22e7-a2e7-4413-95fd-68872de078b1 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:25.702959 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a69b22e7-a2e7-4413-95fd-68872de078b1 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:25.704128 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a69b22e7-a2e7-4413-95fd-68872de078b1 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:25.705549 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a69b22e7-a2e7-4413-95fd-68872de078b1 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:25.705991 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a69b22e7-a2e7-4413-95fd-68872de078b1 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:25.720766 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-a69b22e7-a2e7-4413-95fd-68872de078b1 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] HTTP exception thrown: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a69b22e7-a2e7-4413-95fd-68872de078b1 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Request method failure captured: Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: DELETE /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 HTTP/1.1 Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5zsa35CtN8XEl75-3NrP_xD-Z7zHpuMyMzYg4Yxg3B_gzLMFcdAmxPm5DKcxX4gVGQP_eQs5f6ZenY30sXHg0t_LqrszxEv-diPFZcjk3dTV-3lU-D9-lJjSrjszv5Hb2y4cKp0JVmzUOvCBRqHC6SXIi044ZiYUoeMQ6oo3fWTG1o Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 536b36bd517a4dca8706718f6bab9c1a Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:20:25.722318 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:20:25.724042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/536b36bd517a4dca8706718f6bab9c1a"}]}] Jun 16 21:20:25.724042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:20:25.724042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 536b36bd517a4dca8706718f6bab9c1a Jun 16 21:20:25.724042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:20:25.724042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-AttachVolumeTestJSON-1205751699-project Jun 16 21:20:25.724042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:20:25.724042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:20:25.724042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 9c13ce02fca548c5b1186a536a2d4474 Jun 16 21:20:25.724042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-AttachVolumeTestJSON-1205751699-project Jun 16 21:20:25.724042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:20:25.724042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. Jun 16 21:20:25.724042 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '319ab15e-eeb3-4557-9840-4ebfd759e4b3'} Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:25.724968 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. Jun 16 21:20:25.726424 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:25.728377 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a69b22e7-a2e7-4413-95fd-68872de078b1 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Returning 404 to user: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:25.728377 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a69b22e7-a2e7-4413-95fd-68872de078b1 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "DELETE /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 404 len: 111 microversion: 2.1 time: 0.035661 Jun 16 21:20:25.728377 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 557/1080] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:20:25 2022] DELETE /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:20:25.734066 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c9a6d500-9a0b-4d1c-b10f-a237563780a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:25.734702 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c9a6d500-9a0b-4d1c-b10f-a237563780a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 319ab15e-eeb3-4557-9840-4ebfd759e4b3] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:25.741154 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c9a6d500-9a0b-4d1c-b10f-a237563780a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:25.741606 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c9a6d500-9a0b-4d1c-b10f-a237563780a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:25.742390 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c9a6d500-9a0b-4d1c-b10f-a237563780a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:25.742826 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c9a6d500-9a0b-4d1c-b10f-a237563780a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:25.757694 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-c9a6d500-9a0b-4d1c-b10f-a237563780a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] HTTP exception thrown: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c9a6d500-9a0b-4d1c-b10f-a237563780a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Request method failure captured: Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 HTTP/1.1 Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq5zsa35CtN8XEl75-3NrP_xD-Z7zHpuMyMzYg4Yxg3B_gzLMFcdAmxPm5DKcxX4gVGQP_eQs5f6ZenY30sXHg0t_LqrszxEv-diPFZcjk3dTV-3lU-D9-lJjSrjszv5Hb2y4cKp0JVmzUOvCBRqHC6SXIi044ZiYUoeMQ6oo3fWTG1o Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 536b36bd517a4dca8706718f6bab9c1a Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:20:25.759553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:20:25.761288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/536b36bd517a4dca8706718f6bab9c1a"}]}] Jun 16 21:20:25.761288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:20:25.761288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 536b36bd517a4dca8706718f6bab9c1a Jun 16 21:20:25.761288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:20:25.761288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-AttachVolumeTestJSON-1205751699-project Jun 16 21:20:25.761288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:20:25.761288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:20:25.761288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 9c13ce02fca548c5b1186a536a2d4474 Jun 16 21:20:25.761288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-AttachVolumeTestJSON-1205751699-project Jun 16 21:20:25.761288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:20:25.761288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. Jun 16 21:20:25.761288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '319ab15e-eeb3-4557-9840-4ebfd759e4b3'} Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:25.762114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. Jun 16 21:20:25.763402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:25.764556 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c9a6d500-9a0b-4d1c-b10f-a237563780a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Returning 404 to user: Instance 319ab15e-eeb3-4557-9840-4ebfd759e4b3 could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:25.764556 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c9a6d500-9a0b-4d1c-b10f-a237563780a2 tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3" status: 404 len: 111 microversion: 2.1 time: 0.032022 Jun 16 21:20:25.764556 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 524/1081] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:25 2022] GET /compute/v2.1/servers/319ab15e-eeb3-4557-9840-4ebfd759e4b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:20:26.900011 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7e8828c2-0a3d-45a8-aa3b-dd35bc090f9d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:26.900574 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7e8828c2-0a3d-45a8-aa3b-dd35bc090f9d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:26.910693 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7e8828c2-0a3d-45a8-aa3b-dd35bc090f9d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:26.911213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7e8828c2-0a3d-45a8-aa3b-dd35bc090f9d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:26.912389 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7e8828c2-0a3d-45a8-aa3b-dd35bc090f9d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:26.918361 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7e8828c2-0a3d-45a8-aa3b-dd35bc090f9d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:26.936281 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-7e8828c2-0a3d-45a8-aa3b-dd35bc090f9d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] HTTP exception thrown: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7e8828c2-0a3d-45a8-aa3b-dd35bc090f9d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Request method failure captured: Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: DELETE /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 HTTP/1.1 Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5zsa35CtN8XEl75-3NrP_xD-Z7zHpuMyMzYg4Yxg3B_gzLMFcdAmxPm5DKcxX4gVGQP_eQs5f6ZenY30sXHg0t_LqrszxEv-diPFZcjk3dTV-3lU-D9-lJjSrjszv5Hb2y4cKp0JVmzUOvCBRqHC6SXIi044ZiYUoeMQ6oo3fWTG1o Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 536b36bd517a4dca8706718f6bab9c1a Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:20:26.938129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:20:26.939452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/536b36bd517a4dca8706718f6bab9c1a"}]}] Jun 16 21:20:26.939452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:20:26.939452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 536b36bd517a4dca8706718f6bab9c1a Jun 16 21:20:26.939452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:20:26.939452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-AttachVolumeTestJSON-1205751699-project Jun 16 21:20:26.939452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:20:26.939452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:20:26.939452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 9c13ce02fca548c5b1186a536a2d4474 Jun 16 21:20:26.939452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-AttachVolumeTestJSON-1205751699-project Jun 16 21:20:26.939452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:20:26.939452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. Jun 16 21:20:26.939452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '499ae55d-60f9-480c-9ecd-794a1cee0da5'} Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:26.940213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. Jun 16 21:20:26.942708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:26.944644 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7e8828c2-0a3d-45a8-aa3b-dd35bc090f9d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Returning 404 to user: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:26.944644 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7e8828c2-0a3d-45a8-aa3b-dd35bc090f9d tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "DELETE /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 404 len: 111 microversion: 2.1 time: 0.043513 Jun 16 21:20:26.944644 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 558/1082] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:20:26 2022] DELETE /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:20:26.949170 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-cfb2a858-3a42-4bec-97f6-fd33e0f1252f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:26.949797 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-cfb2a858-3a42-4bec-97f6-fd33e0f1252f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] [instance: 499ae55d-60f9-480c-9ecd-794a1cee0da5] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:26.959799 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cfb2a858-3a42-4bec-97f6-fd33e0f1252f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:26.960301 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cfb2a858-3a42-4bec-97f6-fd33e0f1252f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:26.961176 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cfb2a858-3a42-4bec-97f6-fd33e0f1252f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:26.961741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cfb2a858-3a42-4bec-97f6-fd33e0f1252f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:26.975625 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-cfb2a858-3a42-4bec-97f6-fd33e0f1252f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] HTTP exception thrown: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-cfb2a858-3a42-4bec-97f6-fd33e0f1252f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Request method failure captured: Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 HTTP/1.1 Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq5zsa35CtN8XEl75-3NrP_xD-Z7zHpuMyMzYg4Yxg3B_gzLMFcdAmxPm5DKcxX4gVGQP_eQs5f6ZenY30sXHg0t_LqrszxEv-diPFZcjk3dTV-3lU-D9-lJjSrjszv5Hb2y4cKp0JVmzUOvCBRqHC6SXIi044ZiYUoeMQ6oo3fWTG1o Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 536b36bd517a4dca8706718f6bab9c1a Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:20:26.977624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:20:26.979338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/536b36bd517a4dca8706718f6bab9c1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/536b36bd517a4dca8706718f6bab9c1a"}]}] Jun 16 21:20:26.979338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:20:26.979338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 536b36bd517a4dca8706718f6bab9c1a Jun 16 21:20:26.979338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1205751699 Jun 16 21:20:26.979338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-AttachVolumeTestJSON-1205751699-project Jun 16 21:20:26.979338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:20:26.979338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:20:26.979338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 9c13ce02fca548c5b1186a536a2d4474 Jun 16 21:20:26.979338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-AttachVolumeTestJSON-1205751699-project Jun 16 21:20:26.979338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:20:26.979338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. Jun 16 21:20:26.979338 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '499ae55d-60f9-480c-9ecd-794a1cee0da5'} Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:26.980225 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. Jun 16 21:20:26.981681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:26.982963 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-cfb2a858-3a42-4bec-97f6-fd33e0f1252f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] Returning 404 to user: Instance 499ae55d-60f9-480c-9ecd-794a1cee0da5 could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:26.982963 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-cfb2a858-3a42-4bec-97f6-fd33e0f1252f tempest-AttachVolumeTestJSON-1205751699 tempest-AttachVolumeTestJSON-1205751699-project] 10.222.0.43 "GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5" status: 404 len: 111 microversion: 2.1 time: 0.033986 Jun 16 21:20:26.982963 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 525/1083] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:26 2022] GET /compute/v2.1/servers/499ae55d-60f9-480c-9ecd-794a1cee0da5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 21:20:39.384502 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-694dbf06-125e-47c4-ae99-7c3d5184cb6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:39.385417 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-694dbf06-125e-47c4-ae99-7c3d5184cb6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:39.388961 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:39.389697 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:39.395461 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-694dbf06-125e-47c4-ae99-7c3d5184cb6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:39.395905 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-694dbf06-125e-47c4-ae99-7c3d5184cb6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:39.396697 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-694dbf06-125e-47c4-ae99-7c3d5184cb6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:39.397122 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-694dbf06-125e-47c4-ae99-7c3d5184cb6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:39.443513 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-694dbf06-125e-47c4-ae99-7c3d5184cb6b tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062923 Jun 16 21:20:39.449117 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 559/1084] 10.222.0.43 () {60 vars in 1342 bytes} [Thu Jun 16 21:20:39 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:39.545927 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-44203a50-05fc-432e-864f-88e87ac95298 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:39.546410 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-44203a50-05fc-432e-864f-88e87ac95298 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:39.548465 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=4 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:39.549661 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:39.550337 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:39.559779 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-44203a50-05fc-432e-864f-88e87ac95298 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:39.560242 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-44203a50-05fc-432e-864f-88e87ac95298 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:39.561212 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-44203a50-05fc-432e-864f-88e87ac95298 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:39.561881 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-44203a50-05fc-432e-864f-88e87ac95298 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:39.595472 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-44203a50-05fc-432e-864f-88e87ac95298 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Going to try to terminate instance {{(pid=117738) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:20:39.696113 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1bba3ace-d5ae-419e-a754-41dbc9271754 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1973995854", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-304404175", "security_groups": [{"name": "tempest-secgroup-smoke-148137412"}], "block_device_mapping_v2": [{"uuid": "f811a247-2f05-4ceb-9e9b-56ea5db025ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61c8c5ff-f4fd-4e8b-b3f3-0e031fc4324d"}]}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:20:39.702655 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-44203a50-05fc-432e-864f-88e87ac95298 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 204 len: 0 microversion: 2.20 time: 0.158934 Jun 16 21:20:39.704137 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 526/1085] 10.222.0.43 () {60 vars in 1279 bytes} [Thu Jun 16 21:20:39 2022] DELETE /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 21:20:39.714436 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d4132c10-9fe0-4ca2-8d42-467c8af36463 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:39.715341 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d4132c10-9fe0-4ca2-8d42-467c8af36463 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:39.723398 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d4132c10-9fe0-4ca2-8d42-467c8af36463 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:39.724245 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d4132c10-9fe0-4ca2-8d42-467c8af36463 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:39.725405 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d4132c10-9fe0-4ca2-8d42-467c8af36463 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:39.726920 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d4132c10-9fe0-4ca2-8d42-467c8af36463 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:39.819007 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.network.neutron [None req-1bba3ace-d5ae-419e-a754-41dbc9271754 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] validate_networks() for [('61c8c5ff-f4fd-4e8b-b3f3-0e031fc4324d', None, None, None, None, None)] {{(pid=117737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:20:39.961360 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d4132c10-9fe0-4ca2-8d42-467c8af36463 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:39.974463 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d4132c10-9fe0-4ca2-8d42-467c8af36463 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:39.979094 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d4132c10-9fe0-4ca2-8d42-467c8af36463 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:39.980922 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d4132c10-9fe0-4ca2-8d42-467c8af36463 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.271505 Jun 16 21:20:39.981636 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 527/1086] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:20:39 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:20:40.211073 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-1bba3ace-d5ae-419e-a754-41dbc9271754 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Flavor limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:20:40.211673 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-1bba3ace-d5ae-419e-a754-41dbc9271754 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Image limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:20:40.212410 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-1bba3ace-d5ae-419e-a754-41dbc9271754 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Flavor pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:20:40.213456 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-1bba3ace-d5ae-419e-a754-41dbc9271754 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Image pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:20:40.213944 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-1bba3ace-d5ae-419e-a754-41dbc9271754 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:20:40.224751 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1bba3ace-d5ae-419e-a754-41dbc9271754 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:40.225481 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1bba3ace-d5ae-419e-a754-41dbc9271754 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:40.226535 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1bba3ace-d5ae-419e-a754-41dbc9271754 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:40.228110 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1bba3ace-d5ae-419e-a754-41dbc9271754 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:40.246436 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-1bba3ace-d5ae-419e-a754-41dbc9271754 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Getting quotas for project b568a213302f46fda9ab9467d36996c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:20:40.250570 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-1bba3ace-d5ae-419e-a754-41dbc9271754 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Getting quotas for user 236f49a4117f488ea8bf5c523fadadc8 and project b568a213302f46fda9ab9467d36996c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:20:40.312022 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1bba3ace-d5ae-419e-a754-41dbc9271754 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Going to run 1 instances... {{(pid=117737) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:20:40.314301 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1bba3ace-d5ae-419e-a754-41dbc9271754 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f811a247-2f05-4ceb-9e9b-56ea5db025ef',volume_size=None,volume_type=None)] {{(pid=117737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:20:40.479109 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1bba3ace-d5ae-419e-a754-41dbc9271754 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.787843 Jun 16 21:20:40.479756 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 560/1087] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:20:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:20:40.492790 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3eb62dff-52fa-43e9-920b-7acf5decdfc9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:40.494233 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-3eb62dff-52fa-43e9-920b-7acf5decdfc9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:40.569136 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-3eb62dff-52fa-43e9-920b-7acf5decdfc9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:40.575960 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-3eb62dff-52fa-43e9-920b-7acf5decdfc9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1094 microversion: 2.1 time: 0.090582 Jun 16 21:20:40.580843 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 528/1088] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:40 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1094 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:41.004975 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-945db670-fbf3-4b34-8394-cb3f7df2d308 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:41.004975 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-945db670-fbf3-4b34-8394-cb3f7df2d308 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:41.014833 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-945db670-fbf3-4b34-8394-cb3f7df2d308 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:41.015279 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-945db670-fbf3-4b34-8394-cb3f7df2d308 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:41.016047 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-945db670-fbf3-4b34-8394-cb3f7df2d308 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:41.016601 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-945db670-fbf3-4b34-8394-cb3f7df2d308 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:41.149829 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-945db670-fbf3-4b34-8394-cb3f7df2d308 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:41.157755 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-945db670-fbf3-4b34-8394-cb3f7df2d308 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:41.159240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-945db670-fbf3-4b34-8394-cb3f7df2d308 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:41.160960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-945db670-fbf3-4b34-8394-cb3f7df2d308 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.164209 Jun 16 21:20:41.161504 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 561/1089] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:20:40 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:20:41.597064 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-cdb743de-5707-48d9-a6e4-96054772a0e5 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:41.597681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-cdb743de-5707-48d9-a6e4-96054772a0e5 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:41.607415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cdb743de-5707-48d9-a6e4-96054772a0e5 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:41.607862 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cdb743de-5707-48d9-a6e4-96054772a0e5 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:41.608679 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cdb743de-5707-48d9-a6e4-96054772a0e5 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:41.609112 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cdb743de-5707-48d9-a6e4-96054772a0e5 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:41.672923 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-cdb743de-5707-48d9-a6e4-96054772a0e5 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:41.680524 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-cdb743de-5707-48d9-a6e4-96054772a0e5 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1144 microversion: 2.1 time: 0.087364 Jun 16 21:20:41.681081 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 529/1090] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:41 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:42.179690 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-41f554e9-c00a-4704-8bbd-563387898e2c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:42.180245 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-41f554e9-c00a-4704-8bbd-563387898e2c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:42.187068 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-41f554e9-c00a-4704-8bbd-563387898e2c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:42.187502 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-41f554e9-c00a-4704-8bbd-563387898e2c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:42.188301 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-41f554e9-c00a-4704-8bbd-563387898e2c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:42.188732 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-41f554e9-c00a-4704-8bbd-563387898e2c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:42.321744 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-41f554e9-c00a-4704-8bbd-563387898e2c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:42.329816 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-41f554e9-c00a-4704-8bbd-563387898e2c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:42.331313 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-41f554e9-c00a-4704-8bbd-563387898e2c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:42.332946 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-41f554e9-c00a-4704-8bbd-563387898e2c tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.157710 Jun 16 21:20:42.333548 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 562/1091] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:20:42 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:20:42.702026 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7fee3fdd-588d-46b6-8e0a-91986b163404 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:42.702666 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7fee3fdd-588d-46b6-8e0a-91986b163404 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:42.709930 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7fee3fdd-588d-46b6-8e0a-91986b163404 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:42.710314 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7fee3fdd-588d-46b6-8e0a-91986b163404 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:42.711285 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7fee3fdd-588d-46b6-8e0a-91986b163404 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:42.711710 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7fee3fdd-588d-46b6-8e0a-91986b163404 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:42.773363 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-7fee3fdd-588d-46b6-8e0a-91986b163404 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:42.780727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7fee3fdd-588d-46b6-8e0a-91986b163404 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1144 microversion: 2.1 time: 0.082650 Jun 16 21:20:42.781288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 530/1092] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:42 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:43.074201 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7789174e-a92a-4595-a239-cac8b0559b89 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-504146441", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452", "networks": [{"uuid": "91b7ccee-e055-4907-b88a-7403ae972460"}]}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:20:43.125732 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.network.neutron [None req-7789174e-a92a-4595-a239-cac8b0559b89 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] validate_networks() for [('91b7ccee-e055-4907-b88a-7403ae972460', None, None, None, None, None)] {{(pid=117737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:20:43.356124 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-30b558a9-9e59-46af-be77-a367945224bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:43.356124 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-30b558a9-9e59-46af-be77-a367945224bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:43.365044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-30b558a9-9e59-46af-be77-a367945224bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:43.366635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-30b558a9-9e59-46af-be77-a367945224bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:43.368599 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-30b558a9-9e59-46af-be77-a367945224bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:43.369059 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-30b558a9-9e59-46af-be77-a367945224bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:43.579711 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-7789174e-a92a-4595-a239-cac8b0559b89 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Flavor limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:20:43.580747 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-7789174e-a92a-4595-a239-cac8b0559b89 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Image limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:20:43.581443 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-7789174e-a92a-4595-a239-cac8b0559b89 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Flavor pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:20:43.582187 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-7789174e-a92a-4595-a239-cac8b0559b89 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Image pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:20:43.582946 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-7789174e-a92a-4595-a239-cac8b0559b89 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:20:43.594703 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7789174e-a92a-4595-a239-cac8b0559b89 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:43.595479 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7789174e-a92a-4595-a239-cac8b0559b89 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:43.597060 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7789174e-a92a-4595-a239-cac8b0559b89 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:43.598247 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7789174e-a92a-4595-a239-cac8b0559b89 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:43.621276 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-7789174e-a92a-4595-a239-cac8b0559b89 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Getting quotas for project 404175dcaa0144fab98ad34e4834de35. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:20:43.625308 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-7789174e-a92a-4595-a239-cac8b0559b89 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Getting quotas for user 105646575b4748a88700db4117174c0c and project 404175dcaa0144fab98ad34e4834de35. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:20:43.635697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-30b558a9-9e59-46af-be77-a367945224bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:43.638250 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7789174e-a92a-4595-a239-cac8b0559b89 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Going to run 1 instances... {{(pid=117737) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:20:43.640439 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7789174e-a92a-4595-a239-cac8b0559b89 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:20:43.644434 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-30b558a9-9e59-46af-be77-a367945224bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:43.646151 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-30b558a9-9e59-46af-be77-a367945224bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:43.647331 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-30b558a9-9e59-46af-be77-a367945224bc tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1722 microversion: 2.20 time: 0.300481 Jun 16 21:20:43.648196 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 531/1093] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:20:43 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 21:20:43.687538 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7789174e-a92a-4595-a239-cac8b0559b89 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617122 Jun 16 21:20:43.688240 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 563/1094] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:20:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:20:43.698504 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-414ef537-1a97-4e35-b930-b1a7b68877ac tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:43.699125 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-414ef537-1a97-4e35-b930-b1a7b68877ac tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:43.758933 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-414ef537-1a97-4e35-b930-b1a7b68877ac tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:43.767674 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-414ef537-1a97-4e35-b930-b1a7b68877ac tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1213 microversion: 2.1 time: 0.072939 Jun 16 21:20:43.772371 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 532/1095] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:43 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:20:43.797668 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9abf8e76-7c44-4e7b-bb77-c6718a6fc0af tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:43.798292 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-9abf8e76-7c44-4e7b-bb77-c6718a6fc0af tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:43.805009 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9abf8e76-7c44-4e7b-bb77-c6718a6fc0af tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:43.805573 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9abf8e76-7c44-4e7b-bb77-c6718a6fc0af tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:43.806345 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9abf8e76-7c44-4e7b-bb77-c6718a6fc0af tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:43.806977 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9abf8e76-7c44-4e7b-bb77-c6718a6fc0af tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:43.871250 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9abf8e76-7c44-4e7b-bb77-c6718a6fc0af tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:43.879935 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9abf8e76-7c44-4e7b-bb77-c6718a6fc0af tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1192 microversion: 2.1 time: 0.085637 Jun 16 21:20:43.880847 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 564/1096] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:43 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:44.668111 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9dfaa792-76d2-4a42-84ad-20e9e87c570a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:44.668791 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-9dfaa792-76d2-4a42-84ad-20e9e87c570a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:44.686016 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9dfaa792-76d2-4a42-84ad-20e9e87c570a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:44.686563 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9dfaa792-76d2-4a42-84ad-20e9e87c570a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:44.693281 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9dfaa792-76d2-4a42-84ad-20e9e87c570a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:44.693730 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9dfaa792-76d2-4a42-84ad-20e9e87c570a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:44.785989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b4acb74a-deea-4c3a-86ac-d91603ff4332 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:44.787570 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b4acb74a-deea-4c3a-86ac-d91603ff4332 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:44.802823 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b4acb74a-deea-4c3a-86ac-d91603ff4332 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:44.803974 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b4acb74a-deea-4c3a-86ac-d91603ff4332 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:44.806407 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b4acb74a-deea-4c3a-86ac-d91603ff4332 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:44.807946 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b4acb74a-deea-4c3a-86ac-d91603ff4332 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:44.861038 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9dfaa792-76d2-4a42-84ad-20e9e87c570a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:44.900309 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9dfaa792-76d2-4a42-84ad-20e9e87c570a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:44.901893 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9dfaa792-76d2-4a42-84ad-20e9e87c570a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:44.913777 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-9dfaa792-76d2-4a42-84ad-20e9e87c570a tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1655 microversion: 2.20 time: 0.249819 Jun 16 21:20:44.916847 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 533/1097] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:20:44 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1655 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:20:44.932965 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-281f5962-7b34-4c48-9580-d8f939e1cd8a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:44.934198 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-281f5962-7b34-4c48-9580-d8f939e1cd8a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:44.946751 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-281f5962-7b34-4c48-9580-d8f939e1cd8a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:44.949622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-281f5962-7b34-4c48-9580-d8f939e1cd8a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:44.951816 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-281f5962-7b34-4c48-9580-d8f939e1cd8a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:44.953976 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-281f5962-7b34-4c48-9580-d8f939e1cd8a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:45.064511 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b4acb74a-deea-4c3a-86ac-d91603ff4332 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:45.077244 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b4acb74a-deea-4c3a-86ac-d91603ff4332 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1273 microversion: 2.1 time: 0.294787 Jun 16 21:20:45.078359 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 565/1098] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:44 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:45.281228 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-281f5962-7b34-4c48-9580-d8f939e1cd8a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:45.297007 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-281f5962-7b34-4c48-9580-d8f939e1cd8a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1210 microversion: 2.1 time: 0.371612 Jun 16 21:20:45.306976 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 534/1099] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:44 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1210 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:45.309737 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-538639df-eeef-4a42-a709-3b86399ab203 req-88afc68a-0070-43f2-b823-8547aa07e673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1b5610-fa96-44cf-b05b-41a354370d1c", "name": "network-vif-deleted", "tag": "ce808840-2e04-4b62-89bc-caeba961a739"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:20:45.330859 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-538639df-eeef-4a42-a709-3b86399ab203 req-88afc68a-0070-43f2-b823-8547aa07e673 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:45.332631 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-538639df-eeef-4a42-a709-3b86399ab203 req-88afc68a-0070-43f2-b823-8547aa07e673 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:45.359163 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-538639df-eeef-4a42-a709-3b86399ab203 req-88afc68a-0070-43f2-b823-8547aa07e673 service nova] Creating event network-vif-deleted:ce808840-2e04-4b62-89bc-caeba961a739 for instance 6a1b5610-fa96-44cf-b05b-41a354370d1c on hv-cinder-81914 Jun 16 21:20:45.367493 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-538639df-eeef-4a42-a709-3b86399ab203 req-88afc68a-0070-43f2-b823-8547aa07e673 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061254 Jun 16 21:20:45.368670 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 566/1100] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:20:45.940262 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-24311033-e21d-4609-8752-65e222c84198 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:45.940889 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-24311033-e21d-4609-8752-65e222c84198 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:45.949333 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-24311033-e21d-4609-8752-65e222c84198 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:45.950862 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-24311033-e21d-4609-8752-65e222c84198 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:45.951885 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-24311033-e21d-4609-8752-65e222c84198 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:45.960149 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-24311033-e21d-4609-8752-65e222c84198 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:46.007645 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-24311033-e21d-4609-8752-65e222c84198 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:46.009587 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-24311033-e21d-4609-8752-65e222c84198 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:46.010047 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.objects.instance [None req-24311033-e21d-4609-8752-65e222c84198 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lazy-loading 'fault' on Instance uuid 6a1b5610-fa96-44cf-b05b-41a354370d1c {{(pid=117738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:20:46.074799 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-24311033-e21d-4609-8752-65e222c84198 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:46.083685 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-24311033-e21d-4609-8752-65e222c84198 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:46.085633 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-24311033-e21d-4609-8752-65e222c84198 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:46.087060 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-24311033-e21d-4609-8752-65e222c84198 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1371 microversion: 2.20 time: 0.151744 Jun 16 21:20:46.088241 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 535/1101] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:20:45 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:20:46.103432 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7eebb7dd-e254-4ebe-9069-dbaa58813974 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:46.104949 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7eebb7dd-e254-4ebe-9069-dbaa58813974 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:46.115850 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7eebb7dd-e254-4ebe-9069-dbaa58813974 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:46.116804 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7eebb7dd-e254-4ebe-9069-dbaa58813974 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:46.117653 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7eebb7dd-e254-4ebe-9069-dbaa58813974 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:46.118100 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7eebb7dd-e254-4ebe-9069-dbaa58813974 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:46.204589 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7eebb7dd-e254-4ebe-9069-dbaa58813974 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:46.213920 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7eebb7dd-e254-4ebe-9069-dbaa58813974 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1271 microversion: 2.1 time: 0.122794 Jun 16 21:20:46.224469 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 567/1102] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:46 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:46.317768 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-ca3f0671-4bc0-44c7-8a95-c0b6b88f94d9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:46.318396 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-ca3f0671-4bc0-44c7-8a95-c0b6b88f94d9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:46.325055 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ca3f0671-4bc0-44c7-8a95-c0b6b88f94d9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:46.325503 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ca3f0671-4bc0-44c7-8a95-c0b6b88f94d9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:46.326509 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ca3f0671-4bc0-44c7-8a95-c0b6b88f94d9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:46.326947 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-ca3f0671-4bc0-44c7-8a95-c0b6b88f94d9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:46.471207 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-ca3f0671-4bc0-44c7-8a95-c0b6b88f94d9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:46.480113 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-ca3f0671-4bc0-44c7-8a95-c0b6b88f94d9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.166920 Jun 16 21:20:46.488553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 536/1103] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:46 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:47.106121 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-604f3069-a157-4583-a4b1-bab291efc181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:47.106731 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-604f3069-a157-4583-a4b1-bab291efc181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:47.113199 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-604f3069-a157-4583-a4b1-bab291efc181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:47.114688 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-604f3069-a157-4583-a4b1-bab291efc181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:47.115447 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-604f3069-a157-4583-a4b1-bab291efc181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:47.115876 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-604f3069-a157-4583-a4b1-bab291efc181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:47.146785 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-604f3069-a157-4583-a4b1-bab291efc181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:47.147224 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-604f3069-a157-4583-a4b1-bab291efc181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:47.147666 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.objects.instance [None req-604f3069-a157-4583-a4b1-bab291efc181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lazy-loading 'fault' on Instance uuid 6a1b5610-fa96-44cf-b05b-41a354370d1c {{(pid=117737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:20:47.187734 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-604f3069-a157-4583-a4b1-bab291efc181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:47.196515 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-604f3069-a157-4583-a4b1-bab291efc181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:47.197997 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-604f3069-a157-4583-a4b1-bab291efc181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:47.199143 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-604f3069-a157-4583-a4b1-bab291efc181 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1371 microversion: 2.20 time: 0.097085 Jun 16 21:20:47.199688 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 568/1104] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:20:47 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:20:47.230663 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-cc711405-f95d-4340-873a-2e1eb68de573 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:47.231276 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-cc711405-f95d-4340-873a-2e1eb68de573 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:47.237755 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cc711405-f95d-4340-873a-2e1eb68de573 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:47.238204 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cc711405-f95d-4340-873a-2e1eb68de573 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:47.239488 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cc711405-f95d-4340-873a-2e1eb68de573 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:47.239920 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cc711405-f95d-4340-873a-2e1eb68de573 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:47.381040 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-cc711405-f95d-4340-873a-2e1eb68de573 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:47.388533 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-cc711405-f95d-4340-873a-2e1eb68de573 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1313 microversion: 2.1 time: 0.161705 Jun 16 21:20:47.389099 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 537/1105] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:47 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:47.496783 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-93040487-fcb6-4c6b-9b39-60849114d525 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:47.497399 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-93040487-fcb6-4c6b-9b39-60849114d525 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:47.503320 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-93040487-fcb6-4c6b-9b39-60849114d525 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:47.503764 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-93040487-fcb6-4c6b-9b39-60849114d525 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:47.504587 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-93040487-fcb6-4c6b-9b39-60849114d525 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:47.505021 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-93040487-fcb6-4c6b-9b39-60849114d525 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:47.637989 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-93040487-fcb6-4c6b-9b39-60849114d525 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:47.646188 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-93040487-fcb6-4c6b-9b39-60849114d525 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.153405 Jun 16 21:20:47.646752 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 569/1106] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:47 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:48.217100 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4f90f9fb-eecf-44c9-b220-034ea8ed6f86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:48.217704 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4f90f9fb-eecf-44c9-b220-034ea8ed6f86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:48.224462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4f90f9fb-eecf-44c9-b220-034ea8ed6f86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:48.224903 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4f90f9fb-eecf-44c9-b220-034ea8ed6f86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:48.225652 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4f90f9fb-eecf-44c9-b220-034ea8ed6f86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:48.226102 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4f90f9fb-eecf-44c9-b220-034ea8ed6f86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:48.256285 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4f90f9fb-eecf-44c9-b220-034ea8ed6f86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:48.256895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4f90f9fb-eecf-44c9-b220-034ea8ed6f86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:48.257146 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.objects.instance [None req-4f90f9fb-eecf-44c9-b220-034ea8ed6f86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lazy-loading 'fault' on Instance uuid 6a1b5610-fa96-44cf-b05b-41a354370d1c {{(pid=117738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:20:48.301917 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4f90f9fb-eecf-44c9-b220-034ea8ed6f86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:48.309700 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4f90f9fb-eecf-44c9-b220-034ea8ed6f86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:48.311209 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4f90f9fb-eecf-44c9-b220-034ea8ed6f86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cc395fc4407473e9595bc99c6b6b36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:48.312399 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4f90f9fb-eecf-44c9-b220-034ea8ed6f86 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 200 len: 1371 microversion: 2.20 time: 0.099147 Jun 16 21:20:48.312946 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 538/1107] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:20:48 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 21:20:48.404973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7751a050-77f1-443e-8a3e-1f6ad43f9fa5 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:48.405589 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7751a050-77f1-443e-8a3e-1f6ad43f9fa5 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:48.412673 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7751a050-77f1-443e-8a3e-1f6ad43f9fa5 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:48.413116 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7751a050-77f1-443e-8a3e-1f6ad43f9fa5 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:48.413876 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7751a050-77f1-443e-8a3e-1f6ad43f9fa5 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:48.414311 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7751a050-77f1-443e-8a3e-1f6ad43f9fa5 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:48.663197 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a4d4533c-b742-4c94-81c4-7f445011e59d tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:48.663811 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a4d4533c-b742-4c94-81c4-7f445011e59d tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:48.669806 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a4d4533c-b742-4c94-81c4-7f445011e59d tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:48.670257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a4d4533c-b742-4c94-81c4-7f445011e59d tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:48.671026 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a4d4533c-b742-4c94-81c4-7f445011e59d tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:48.671456 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a4d4533c-b742-4c94-81c4-7f445011e59d tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:48.683113 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7751a050-77f1-443e-8a3e-1f6ad43f9fa5 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:48.692848 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7751a050-77f1-443e-8a3e-1f6ad43f9fa5 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1313 microversion: 2.1 time: 0.291504 Jun 16 21:20:48.693477 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 570/1108] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:48 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:48.813738 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a4d4533c-b742-4c94-81c4-7f445011e59d tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:48.821929 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a4d4533c-b742-4c94-81c4-7f445011e59d tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.163288 Jun 16 21:20:48.822496 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 539/1109] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:48 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:20:49.333514 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e2b4fb85-2114-4feb-bb29-0dc6b12023a3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:49.334288 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e2b4fb85-2114-4feb-bb29-0dc6b12023a3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:49.340868 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e2b4fb85-2114-4feb-bb29-0dc6b12023a3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:49.341299 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e2b4fb85-2114-4feb-bb29-0dc6b12023a3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:49.342273 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e2b4fb85-2114-4feb-bb29-0dc6b12023a3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:49.342727 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e2b4fb85-2114-4feb-bb29-0dc6b12023a3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:49.363123 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-e2b4fb85-2114-4feb-bb29-0dc6b12023a3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] HTTP exception thrown: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e2b4fb85-2114-4feb-bb29-0dc6b12023a3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Request method failure captured: Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c HTTP/1.1 Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5zk364JTme2zchNS_wRkzhgAVUFjYPIp8nqeDxTS3rFd_cu023F9oDuseuPiqoLxVQ9yNiyTqa7XJ7xJSmJ9WrLK7OVnEPTIrtAILHPclyn5wAtxcylAXIYh6DqvCQiQUEtZ81f2rtCDB7NJ1L1c6bG5Hk1Xp6dQsweJ484rLN1fEg Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 8fd2e5ab99c341d38c3f78dc17c0faf2 Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:20:49.368236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:20:49.370599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}] Jun 16 21:20:49.370599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:20:49.370599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 8fd2e5ab99c341d38c3f78dc17c0faf2 Jun 16 21:20:49.370599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:20:49.370599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-AttachVolumeShelveTestJSON-356244796-project Jun 16 21:20:49.370599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:20:49.370599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:20:49.370599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 8cc395fc4407473e9595bc99c6b6b36c Jun 16 21:20:49.370599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-AttachVolumeShelveTestJSON-356244796-project Jun 16 21:20:49.370599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:20:49.370599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. Jun 16 21:20:49.370599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '6a1b5610-fa96-44cf-b05b-41a354370d1c'} Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:49.371973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. Jun 16 21:20:49.376860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:49.381202 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e2b4fb85-2114-4feb-bb29-0dc6b12023a3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Returning 404 to user: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:49.382898 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e2b4fb85-2114-4feb-bb29-0dc6b12023a3 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 404 len: 111 microversion: 2.20 time: 0.055823 Jun 16 21:20:49.384115 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 571/1110] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:20:49 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 21:20:49.394150 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b4be80ee-da27-49d6-8655-c46988808ac2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '.version_select at 0x7fb3fc073550>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:49.429818 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b4be80ee-da27-49d6-8655-c46988808ac2 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568301273" status: 204 len: 0 microversion: 2.20 time: 0.040890 Jun 16 21:20:49.430850 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 540/1111] 10.222.0.43 () {60 vars in 1261 bytes} [Thu Jun 16 21:20:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568301273 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 21:20:49.716906 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c2dd7d81-281e-4852-a30f-b751de0acb0f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:49.717726 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c2dd7d81-281e-4852-a30f-b751de0acb0f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:49.725425 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c2dd7d81-281e-4852-a30f-b751de0acb0f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:49.725969 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c2dd7d81-281e-4852-a30f-b751de0acb0f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:49.727731 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c2dd7d81-281e-4852-a30f-b751de0acb0f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:49.728382 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c2dd7d81-281e-4852-a30f-b751de0acb0f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:49.843099 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a572af7f-7e33-49e7-a73e-bbf470f1e818 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:49.843705 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a572af7f-7e33-49e7-a73e-bbf470f1e818 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:49.853665 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a572af7f-7e33-49e7-a73e-bbf470f1e818 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:49.855249 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a572af7f-7e33-49e7-a73e-bbf470f1e818 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:49.856381 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a572af7f-7e33-49e7-a73e-bbf470f1e818 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:49.857614 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a572af7f-7e33-49e7-a73e-bbf470f1e818 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:50.036087 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a572af7f-7e33-49e7-a73e-bbf470f1e818 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:50.044499 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a572af7f-7e33-49e7-a73e-bbf470f1e818 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.207543 Jun 16 21:20:50.045140 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 541/1112] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:49 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:50.050142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-566b543d-96c6-47c9-8c9c-40cc849f8514 req-12569c0a-5cf0-4ea2-b271-3a22a275108c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "334a1b5b-c324-4952-9875-f93b251a544c", "tag": "a184de69-92f7-4829-83d3-e946b229e004"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:20:50.058815 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-566b543d-96c6-47c9-8c9c-40cc849f8514 req-12569c0a-5cf0-4ea2-b271-3a22a275108c service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:50.059535 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-566b543d-96c6-47c9-8c9c-40cc849f8514 req-12569c0a-5cf0-4ea2-b271-3a22a275108c service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:50.074857 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-566b543d-96c6-47c9-8c9c-40cc849f8514 req-12569c0a-5cf0-4ea2-b271-3a22a275108c service nova] Creating event network-changed:a184de69-92f7-4829-83d3-e946b229e004 for instance 334a1b5b-c324-4952-9875-f93b251a544c on hv-cinder-81914 Jun 16 21:20:50.081331 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-566b543d-96c6-47c9-8c9c-40cc849f8514 req-12569c0a-5cf0-4ea2-b271-3a22a275108c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034685 Jun 16 21:20:50.081930 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 542/1113] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:20:50.683958 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c2dd7d81-281e-4852-a30f-b751de0acb0f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:50.694746 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c2dd7d81-281e-4852-a30f-b751de0acb0f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1313 microversion: 2.1 time: 0.988276 Jun 16 21:20:50.709111 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 572/1114] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:49 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1313 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:51.072663 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-42c24452-072e-4d91-9bac-9d496f04f37a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:51.073349 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-42c24452-072e-4d91-9bac-9d496f04f37a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:51.080563 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-42c24452-072e-4d91-9bac-9d496f04f37a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:51.081298 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-42c24452-072e-4d91-9bac-9d496f04f37a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:51.082095 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-42c24452-072e-4d91-9bac-9d496f04f37a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:51.082639 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-42c24452-072e-4d91-9bac-9d496f04f37a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:51.251401 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-42c24452-072e-4d91-9bac-9d496f04f37a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:51.256087 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:51.263139 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-42c24452-072e-4d91-9bac-9d496f04f37a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.195268 Jun 16 21:20:51.264343 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 543/1115] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:51 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:51.718958 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4395711f-cae5-476c-bde6-26ffe0d48a32 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:51.719572 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4395711f-cae5-476c-bde6-26ffe0d48a32 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:51.726123 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4395711f-cae5-476c-bde6-26ffe0d48a32 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:51.726576 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4395711f-cae5-476c-bde6-26ffe0d48a32 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:51.727338 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4395711f-cae5-476c-bde6-26ffe0d48a32 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:51.727771 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4395711f-cae5-476c-bde6-26ffe0d48a32 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:51.864233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4395711f-cae5-476c-bde6-26ffe0d48a32 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:51.871974 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4395711f-cae5-476c-bde6-26ffe0d48a32 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1313 microversion: 2.1 time: 0.156876 Jun 16 21:20:51.872599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 573/1116] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:51 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:52.108099 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-2340a834-7fe4-4bbb-bf66-e9851edbb043 req-0c865141-3142-4106-aa06-3d7124634cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "660282bd-fd1d-4994-a613-a8a906f79462", "tag": "c76974f7-fb59-4c9f-9616-e5a93348d596"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:20:52.118505 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-2340a834-7fe4-4bbb-bf66-e9851edbb043 req-0c865141-3142-4106-aa06-3d7124634cc8 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:52.118887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-2340a834-7fe4-4bbb-bf66-e9851edbb043 req-0c865141-3142-4106-aa06-3d7124634cc8 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:52.131838 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-2340a834-7fe4-4bbb-bf66-e9851edbb043 req-0c865141-3142-4106-aa06-3d7124634cc8 service nova] Creating event network-changed:c76974f7-fb59-4c9f-9616-e5a93348d596 for instance 660282bd-fd1d-4994-a613-a8a906f79462 on hv-cinder-81914 Jun 16 21:20:52.136789 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-2340a834-7fe4-4bbb-bf66-e9851edbb043 req-0c865141-3142-4106-aa06-3d7124634cc8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032770 Jun 16 21:20:52.137383 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 544/1117] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:20:52.279587 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-598c25a0-7d6c-4dc7-96d9-b1e8a3a37bd2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:52.280235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-598c25a0-7d6c-4dc7-96d9-b1e8a3a37bd2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:52.287502 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-598c25a0-7d6c-4dc7-96d9-b1e8a3a37bd2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:52.287829 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-598c25a0-7d6c-4dc7-96d9-b1e8a3a37bd2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:52.288663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-598c25a0-7d6c-4dc7-96d9-b1e8a3a37bd2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:52.289100 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-598c25a0-7d6c-4dc7-96d9-b1e8a3a37bd2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:52.431109 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-598c25a0-7d6c-4dc7-96d9-b1e8a3a37bd2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:52.438740 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-598c25a0-7d6c-4dc7-96d9-b1e8a3a37bd2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.162984 Jun 16 21:20:52.439297 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 574/1118] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:52 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:52.889518 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0410466b-fb14-4570-9147-4067ae9e41a8 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:52.890256 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0410466b-fb14-4570-9147-4067ae9e41a8 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:52.897256 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0410466b-fb14-4570-9147-4067ae9e41a8 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:52.897697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0410466b-fb14-4570-9147-4067ae9e41a8 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:52.898455 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0410466b-fb14-4570-9147-4067ae9e41a8 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:52.898887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0410466b-fb14-4570-9147-4067ae9e41a8 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:53.038955 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0410466b-fb14-4570-9147-4067ae9e41a8 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:53.046287 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0410466b-fb14-4570-9147-4067ae9e41a8 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1313 microversion: 2.1 time: 0.161050 Jun 16 21:20:53.046869 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 545/1119] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:52 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:53.454804 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-2a015365-276f-4cf3-93c4-3c31638fe31f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:53.455418 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-2a015365-276f-4cf3-93c4-3c31638fe31f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:53.462009 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2a015365-276f-4cf3-93c4-3c31638fe31f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:53.462452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2a015365-276f-4cf3-93c4-3c31638fe31f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:53.463213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2a015365-276f-4cf3-93c4-3c31638fe31f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:53.463645 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2a015365-276f-4cf3-93c4-3c31638fe31f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:53.593864 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2a015365-276f-4cf3-93c4-3c31638fe31f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:53.602107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-2a015365-276f-4cf3-93c4-3c31638fe31f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.151150 Jun 16 21:20:53.602673 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 575/1120] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:53 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:54.063824 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-429a04d9-adec-4d53-a353-edbb4dfe74eb tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:54.064449 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-429a04d9-adec-4d53-a353-edbb4dfe74eb tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:54.067536 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=4 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:54.074788 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-429a04d9-adec-4d53-a353-edbb4dfe74eb tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:54.075421 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-429a04d9-adec-4d53-a353-edbb4dfe74eb tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:54.076212 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-429a04d9-adec-4d53-a353-edbb4dfe74eb tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:54.076653 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-429a04d9-adec-4d53-a353-edbb4dfe74eb tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:54.210008 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-429a04d9-adec-4d53-a353-edbb4dfe74eb tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:54.217465 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-429a04d9-adec-4d53-a353-edbb4dfe74eb tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1313 microversion: 2.1 time: 0.157568 Jun 16 21:20:54.218033 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 546/1121] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:54 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:54.589901 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1d685c0a-3a76-4070-bdf4-403bc81e9da9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:54.590488 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1d685c0a-3a76-4070-bdf4-403bc81e9da9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:54.592646 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=4 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:54.593346 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=12 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:54.600188 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1d685c0a-3a76-4070-bdf4-403bc81e9da9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:54.600714 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1d685c0a-3a76-4070-bdf4-403bc81e9da9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:54.601657 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1d685c0a-3a76-4070-bdf4-403bc81e9da9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:54.602154 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1d685c0a-3a76-4070-bdf4-403bc81e9da9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:54.618263 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-1d685c0a-3a76-4070-bdf4-403bc81e9da9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] HTTP exception thrown: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. Jun 16 21:20:54.619308 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b064a005-f92e-4082-a7a6-63ba324140c2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1d685c0a-3a76-4070-bdf4-403bc81e9da9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Request method failure captured: Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: DELETE /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c HTTP/1.1 Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5zk364JTme2zchNS_wRkzhgAVUFjYPIp8nqeDxTS3rFd_cu023F9oDuseuPiqoLxVQ9yNiyTqa7XJ7xJSmJ9WrLK7OVnEPTIrtAILHPclyn5wAtxcylAXIYh6DqvCQiQUEtZ81f2rtCDB7NJ1L1c6bG5Hk1Xp6dQsweJ484rLN1fEg Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 8fd2e5ab99c341d38c3f78dc17c0faf2 Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:20:54.619892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:20:54.621844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}] Jun 16 21:20:54.621844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:20:54.621844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 8fd2e5ab99c341d38c3f78dc17c0faf2 Jun 16 21:20:54.621844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:20:54.621844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-AttachVolumeShelveTestJSON-356244796-project Jun 16 21:20:54.621844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:20:54.621844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:20:54.621844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 8cc395fc4407473e9595bc99c6b6b36c Jun 16 21:20:54.621844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-AttachVolumeShelveTestJSON-356244796-project Jun 16 21:20:54.621844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:20:54.621844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. Jun 16 21:20:54.621844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '6a1b5610-fa96-44cf-b05b-41a354370d1c'} Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:54.622632 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. Jun 16 21:20:54.624006 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:54.625364 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b064a005-f92e-4082-a7a6-63ba324140c2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:54.625804 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1d685c0a-3a76-4070-bdf4-403bc81e9da9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Returning 404 to user: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:54.625804 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1d685c0a-3a76-4070-bdf4-403bc81e9da9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 404 len: 111 microversion: 2.20 time: 0.036278 Jun 16 21:20:54.625804 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 576/1122] 10.222.0.43 () {60 vars in 1279 bytes} [Thu Jun 16 21:20:54 2022] DELETE /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 21:20:54.628330 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b064a005-f92e-4082-a7a6-63ba324140c2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:54.628803 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b064a005-f92e-4082-a7a6-63ba324140c2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:54.630446 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b064a005-f92e-4082-a7a6-63ba324140c2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:54.630916 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b064a005-f92e-4082-a7a6-63ba324140c2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:54.631774 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-aaa8ad3f-8f57-404c-b2a8-b98ea78e45a9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:54.632431 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-aaa8ad3f-8f57-404c-b2a8-b98ea78e45a9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 6a1b5610-fa96-44cf-b05b-41a354370d1c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:54.638517 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-aaa8ad3f-8f57-404c-b2a8-b98ea78e45a9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:54.638963 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-aaa8ad3f-8f57-404c-b2a8-b98ea78e45a9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:54.639723 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-aaa8ad3f-8f57-404c-b2a8-b98ea78e45a9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:54.640157 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-aaa8ad3f-8f57-404c-b2a8-b98ea78e45a9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:54.653721 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-aaa8ad3f-8f57-404c-b2a8-b98ea78e45a9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] HTTP exception thrown: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-aaa8ad3f-8f57-404c-b2a8-b98ea78e45a9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Request method failure captured: Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c HTTP/1.1 Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq5zk364JTme2zchNS_wRkzhgAVUFjYPIp8nqeDxTS3rFd_cu023F9oDuseuPiqoLxVQ9yNiyTqa7XJ7xJSmJ9WrLK7OVnEPTIrtAILHPclyn5wAtxcylAXIYh6DqvCQiQUEtZ81f2rtCDB7NJ1L1c6bG5Hk1Xp6dQsweJ484rLN1fEg Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 8fd2e5ab99c341d38c3f78dc17c0faf2 Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:20:54.655179 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:20:54.656960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}] Jun 16 21:20:54.656960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:20:54.656960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 8fd2e5ab99c341d38c3f78dc17c0faf2 Jun 16 21:20:54.656960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:20:54.656960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-AttachVolumeShelveTestJSON-356244796-project Jun 16 21:20:54.656960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:20:54.656960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:20:54.656960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 8cc395fc4407473e9595bc99c6b6b36c Jun 16 21:20:54.656960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-AttachVolumeShelveTestJSON-356244796-project Jun 16 21:20:54.656960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:20:54.656960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. Jun 16 21:20:54.656960 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '6a1b5610-fa96-44cf-b05b-41a354370d1c'} Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:54.657794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. Jun 16 21:20:54.659079 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:20:54.660235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-aaa8ad3f-8f57-404c-b2a8-b98ea78e45a9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Returning 404 to user: Instance 6a1b5610-fa96-44cf-b05b-41a354370d1c could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:54.660235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-aaa8ad3f-8f57-404c-b2a8-b98ea78e45a9 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c" status: 404 len: 111 microversion: 2.20 time: 0.029858 Jun 16 21:20:54.660235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 577/1123] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:20:54 2022] GET /compute/v2.1/servers/6a1b5610-fa96-44cf-b05b-41a354370d1c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 21:20:54.782908 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b064a005-f92e-4082-a7a6-63ba324140c2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:54.790775 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b064a005-f92e-4082-a7a6-63ba324140c2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.175400 Jun 16 21:20:54.791350 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 547/1124] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:54 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:20:55.234456 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-2458c55b-9ad1-4981-8623-7f0e9e4fb757 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:55.235075 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-2458c55b-9ad1-4981-8623-7f0e9e4fb757 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:55.249142 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2458c55b-9ad1-4981-8623-7f0e9e4fb757 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:55.249588 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2458c55b-9ad1-4981-8623-7f0e9e4fb757 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:55.250371 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2458c55b-9ad1-4981-8623-7f0e9e4fb757 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:55.251332 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2458c55b-9ad1-4981-8623-7f0e9e4fb757 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:55.551434 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2458c55b-9ad1-4981-8623-7f0e9e4fb757 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:55.560881 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-2458c55b-9ad1-4981-8623-7f0e9e4fb757 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1313 microversion: 2.1 time: 0.330242 Jun 16 21:20:55.561563 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 578/1125] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:55 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:55.795792 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-16593306-04f6-4f87-b855-ad0aabfe73c8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:55.796319 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-16593306-04f6-4f87-b855-ad0aabfe73c8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:55.804697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-16593306-04f6-4f87-b855-ad0aabfe73c8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:55.805305 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-16593306-04f6-4f87-b855-ad0aabfe73c8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:55.806255 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-16593306-04f6-4f87-b855-ad0aabfe73c8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:55.806674 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-16593306-04f6-4f87-b855-ad0aabfe73c8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:55.814559 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-74c08b28-18ec-4849-b6ed-d96d4410c734 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:55.814559 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-74c08b28-18ec-4849-b6ed-d96d4410c734 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:55.821489 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-74c08b28-18ec-4849-b6ed-d96d4410c734 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:55.822225 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-74c08b28-18ec-4849-b6ed-d96d4410c734 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:55.823219 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-74c08b28-18ec-4849-b6ed-d96d4410c734 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:55.823899 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-74c08b28-18ec-4849-b6ed-d96d4410c734 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:55.825289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-16593306-04f6-4f87-b855-ad0aabfe73c8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] HTTP exception thrown: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-16593306-04f6-4f87-b855-ad0aabfe73c8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Request method failure captured: Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: DELETE /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 HTTP/1.1 Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq5zk364JTme2zchNS_wRkzhgAVUFjYPIp8nqeDxTS3rFd_cu023F9oDuseuPiqoLxVQ9yNiyTqa7XJ7xJSmJ9WrLK7OVnEPTIrtAILHPclyn5wAtxcylAXIYh6DqvCQiQUEtZ81f2rtCDB7NJ1L1c6bG5Hk1Xp6dQsweJ484rLN1fEg Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 8fd2e5ab99c341d38c3f78dc17c0faf2 Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:20:55.827039 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:20:55.828741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}] Jun 16 21:20:55.828741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:20:55.828741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 8fd2e5ab99c341d38c3f78dc17c0faf2 Jun 16 21:20:55.828741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:20:55.828741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-AttachVolumeShelveTestJSON-356244796-project Jun 16 21:20:55.828741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:20:55.828741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:20:55.828741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 8cc395fc4407473e9595bc99c6b6b36c Jun 16 21:20:55.828741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-AttachVolumeShelveTestJSON-356244796-project Jun 16 21:20:55.828741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:20:55.828741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. Jun 16 21:20:55.828741 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '2281b8c3-ec1f-478b-bd50-128d5cf67a04'} Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:55.829635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. Jun 16 21:20:55.830887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:55.832086 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-16593306-04f6-4f87-b855-ad0aabfe73c8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Returning 404 to user: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:55.832086 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-16593306-04f6-4f87-b855-ad0aabfe73c8 tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 404 len: 111 microversion: 2.20 time: 0.037063 Jun 16 21:20:55.833887 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 548/1126] 10.222.0.43 () {60 vars in 1279 bytes} [Thu Jun 16 21:20:55 2022] DELETE /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 21:20:55.836733 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=100 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:55.838615 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-17f81a24-0861-4cd3-8965-739f913a173e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:55.839288 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-17f81a24-0861-4cd3-8965-739f913a173e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] [instance: 2281b8c3-ec1f-478b-bd50-128d5cf67a04] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:55.852790 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-17f81a24-0861-4cd3-8965-739f913a173e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:55.853568 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-17f81a24-0861-4cd3-8965-739f913a173e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:55.854536 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-17f81a24-0861-4cd3-8965-739f913a173e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:55.855159 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-17f81a24-0861-4cd3-8965-739f913a173e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:55.872443 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-17f81a24-0861-4cd3-8965-739f913a173e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] HTTP exception thrown: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-17f81a24-0861-4cd3-8965-739f913a173e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Request method failure captured: Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 HTTP/1.1 Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq5zk364JTme2zchNS_wRkzhgAVUFjYPIp8nqeDxTS3rFd_cu023F9oDuseuPiqoLxVQ9yNiyTqa7XJ7xJSmJ9WrLK7OVnEPTIrtAILHPclyn5wAtxcylAXIYh6DqvCQiQUEtZ81f2rtCDB7NJ1L1c6bG5Hk1Xp6dQsweJ484rLN1fEg Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 8fd2e5ab99c341d38c3f78dc17c0faf2 Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:20:55.874895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:20:55.876670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8fd2e5ab99c341d38c3f78dc17c0faf2"}]}] Jun 16 21:20:55.876670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:20:55.876670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 8fd2e5ab99c341d38c3f78dc17c0faf2 Jun 16 21:20:55.876670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-356244796 Jun 16 21:20:55.876670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-AttachVolumeShelveTestJSON-356244796-project Jun 16 21:20:55.876670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:20:55.876670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:20:55.876670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 8cc395fc4407473e9595bc99c6b6b36c Jun 16 21:20:55.876670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-AttachVolumeShelveTestJSON-356244796-project Jun 16 21:20:55.876670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:20:55.876670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. Jun 16 21:20:55.876670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '2281b8c3-ec1f-478b-bd50-128d5cf67a04'} Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:20:55.877452 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. Jun 16 21:20:55.880622 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:20:55.881777 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-17f81a24-0861-4cd3-8965-739f913a173e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] Returning 404 to user: Instance 2281b8c3-ec1f-478b-bd50-128d5cf67a04 could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:20:55.881777 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-17f81a24-0861-4cd3-8965-739f913a173e tempest-AttachVolumeShelveTestJSON-356244796 tempest-AttachVolumeShelveTestJSON-356244796-project] 10.222.0.43 "GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04" status: 404 len: 111 microversion: 2.20 time: 0.041883 Jun 16 21:20:55.881777 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 549/1127] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 16 21:20:55 2022] GET /compute/v2.1/servers/2281b8c3-ec1f-478b-bd50-128d5cf67a04 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 21:20:56.019420 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-74c08b28-18ec-4849-b6ed-d96d4410c734 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:56.029984 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-74c08b28-18ec-4849-b6ed-d96d4410c734 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.221777 Jun 16 21:20:56.030563 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 579/1128] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:55 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:56.578529 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c18744c2-f56a-4ca3-8132-46adb20c1fe2 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:56.579152 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c18744c2-f56a-4ca3-8132-46adb20c1fe2 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:56.591174 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c18744c2-f56a-4ca3-8132-46adb20c1fe2 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:56.591828 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c18744c2-f56a-4ca3-8132-46adb20c1fe2 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:56.592688 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c18744c2-f56a-4ca3-8132-46adb20c1fe2 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:56.595305 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c18744c2-f56a-4ca3-8132-46adb20c1fe2 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:56.788382 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c18744c2-f56a-4ca3-8132-46adb20c1fe2 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:56.801239 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c18744c2-f56a-4ca3-8132-46adb20c1fe2 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1313 microversion: 2.1 time: 0.225350 Jun 16 21:20:56.812143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 550/1129] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:56 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:57.051638 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ca763343-046d-4453-9040-b3ca9cd4a987 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:57.052972 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ca763343-046d-4453-9040-b3ca9cd4a987 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:57.059855 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ca763343-046d-4453-9040-b3ca9cd4a987 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:57.060404 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ca763343-046d-4453-9040-b3ca9cd4a987 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:57.061171 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ca763343-046d-4453-9040-b3ca9cd4a987 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:57.061597 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ca763343-046d-4453-9040-b3ca9cd4a987 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:57.291452 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-ca763343-046d-4453-9040-b3ca9cd4a987 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:57.300106 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ca763343-046d-4453-9040-b3ca9cd4a987 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.254569 Jun 16 21:20:57.300867 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 580/1130] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:57 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:57.819215 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-509d28fa-c896-4926-996e-e5aa0550f2d4 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:57.820708 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-509d28fa-c896-4926-996e-e5aa0550f2d4 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:57.828854 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-509d28fa-c896-4926-996e-e5aa0550f2d4 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:57.829396 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-509d28fa-c896-4926-996e-e5aa0550f2d4 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:57.830269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-509d28fa-c896-4926-996e-e5aa0550f2d4 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:57.830807 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-509d28fa-c896-4926-996e-e5aa0550f2d4 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:58.033544 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-509d28fa-c896-4926-996e-e5aa0550f2d4 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:58.042648 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-509d28fa-c896-4926-996e-e5aa0550f2d4 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1313 microversion: 2.1 time: 0.227617 Jun 16 21:20:58.043971 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 551/1131] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:57 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:58.320532 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-7564443f-8560-45cd-a64c-f7d393881fd4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:58.321161 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-7564443f-8560-45cd-a64c-f7d393881fd4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:58.330834 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7564443f-8560-45cd-a64c-f7d393881fd4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:58.331466 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7564443f-8560-45cd-a64c-f7d393881fd4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:58.339106 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7564443f-8560-45cd-a64c-f7d393881fd4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:58.340561 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-7564443f-8560-45cd-a64c-f7d393881fd4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:58.552757 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-7564443f-8560-45cd-a64c-f7d393881fd4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:58.560848 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-7564443f-8560-45cd-a64c-f7d393881fd4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.246949 Jun 16 21:20:58.561567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 581/1132] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:58 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:58.790697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-c42ebc7f-3dbf-4fe4-82e7-be0dce08ddd0 req-3e760d26-1c05-4114-b7eb-581e7d8cbd6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "660282bd-fd1d-4994-a613-a8a906f79462", "name": "network-vif-plugged", "status": "completed", "tag": "c76974f7-fb59-4c9f-9616-e5a93348d596"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:20:58.799853 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-c42ebc7f-3dbf-4fe4-82e7-be0dce08ddd0 req-3e760d26-1c05-4114-b7eb-581e7d8cbd6c service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:58.800381 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-c42ebc7f-3dbf-4fe4-82e7-be0dce08ddd0 req-3e760d26-1c05-4114-b7eb-581e7d8cbd6c service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:58.813423 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-c42ebc7f-3dbf-4fe4-82e7-be0dce08ddd0 req-3e760d26-1c05-4114-b7eb-581e7d8cbd6c service nova] Creating event network-vif-plugged:c76974f7-fb59-4c9f-9616-e5a93348d596 for instance 660282bd-fd1d-4994-a613-a8a906f79462 on hv-cinder-81914 Jun 16 21:20:58.818644 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-c42ebc7f-3dbf-4fe4-82e7-be0dce08ddd0 req-3e760d26-1c05-4114-b7eb-581e7d8cbd6c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032486 Jun 16 21:20:58.819352 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 552/1133] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:20:59.062194 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-578337e0-4631-4ac5-b09f-030d7d5eeb98 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:59.063068 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-578337e0-4631-4ac5-b09f-030d7d5eeb98 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:59.070081 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-578337e0-4631-4ac5-b09f-030d7d5eeb98 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:59.070645 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-578337e0-4631-4ac5-b09f-030d7d5eeb98 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:59.071938 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-578337e0-4631-4ac5-b09f-030d7d5eeb98 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:59.072429 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-578337e0-4631-4ac5-b09f-030d7d5eeb98 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:59.327159 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-578337e0-4631-4ac5-b09f-030d7d5eeb98 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:59.339832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-578337e0-4631-4ac5-b09f-030d7d5eeb98 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1313 microversion: 2.1 time: 0.281159 Jun 16 21:20:59.340862 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 582/1134] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:59 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:20:59.580253 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-10aa7377-c183-4276-b74a-150865d72372 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:20:59.581189 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-10aa7377-c183-4276-b74a-150865d72372 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:20:59.591978 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-10aa7377-c183-4276-b74a-150865d72372 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:59.593822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-10aa7377-c183-4276-b74a-150865d72372 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:59.595615 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-10aa7377-c183-4276-b74a-150865d72372 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:20:59.598019 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-10aa7377-c183-4276-b74a-150865d72372 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:20:59.852611 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-10aa7377-c183-4276-b74a-150865d72372 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:20:59.866557 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-10aa7377-c183-4276-b74a-150865d72372 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.287847 Jun 16 21:20:59.867277 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 553/1135] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:20:59 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:00.358067 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-955b6a64-ccf4-4c8a-a561-9830cd22375b tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:00.359060 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-955b6a64-ccf4-4c8a-a561-9830cd22375b tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:00.366681 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-955b6a64-ccf4-4c8a-a561-9830cd22375b tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:00.367208 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-955b6a64-ccf4-4c8a-a561-9830cd22375b tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:00.367996 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-955b6a64-ccf4-4c8a-a561-9830cd22375b tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:00.368446 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-955b6a64-ccf4-4c8a-a561-9830cd22375b tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:00.547304 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-955b6a64-ccf4-4c8a-a561-9830cd22375b tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:00.578693 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-955b6a64-ccf4-4c8a-a561-9830cd22375b tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1313 microversion: 2.1 time: 0.225234 Jun 16 21:21:00.579565 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 583/1136] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:00 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:00.884388 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-77654bfd-2d63-4e72-8e1f-e2b6db7a233c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:00.885705 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-77654bfd-2d63-4e72-8e1f-e2b6db7a233c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:00.892525 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-77654bfd-2d63-4e72-8e1f-e2b6db7a233c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:00.893519 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-77654bfd-2d63-4e72-8e1f-e2b6db7a233c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:00.896133 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-77654bfd-2d63-4e72-8e1f-e2b6db7a233c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:00.896928 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-77654bfd-2d63-4e72-8e1f-e2b6db7a233c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:01.057763 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-77654bfd-2d63-4e72-8e1f-e2b6db7a233c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:01.066061 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-77654bfd-2d63-4e72-8e1f-e2b6db7a233c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.186292 Jun 16 21:21:01.066619 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 554/1137] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:00 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:21:01.562372 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-de49d57d-9245-4503-9cb8-55f9b66694f7 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Action: 'create', calling method: .version_select at 0x7fb3fc075550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-123472339", "metadata": {"Type": "work"}}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-de49d57d-9245-4503-9cb8-55f9b66694f7 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Request method failure captured: Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 121 Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq569_wjdAgwuCOb--jNZVq4dOUNT_QRjyF8yo-dBBo3uEW7LogsuDBirixVHbnsRyhaISJrHqLKDjlCerbERynI3gznGYLQrL5iFaIvwaLM6ezKCMvzWTUcazqedOu7mbJ2y2FvdZyDa8GFpUPUxuxLqP9KNSV0rA6nyp6cLk9NQuLE Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 5f786493fa40450098fa4b94b1c26214 Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:21:01.583235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:21:01.584993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f786493fa40450098fa4b94b1c26214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5f786493fa40450098fa4b94b1c26214"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f786493fa40450098fa4b94b1c26214"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5f786493fa40450098fa4b94b1c26214"}]}] Jun 16 21:21:01.584993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.584993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 5f786493fa40450098fa4b94b1c26214 Jun 16 21:21:01.584993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.584993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-VolumesNegativeTest-1771769194-project Jun 16 21:21:01.584993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:21:01.584993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:21:01.584993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 7a5d65765c6d4bb9a0e65ebf7c63370b Jun 16 21:21:01.584993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-VolumesNegativeTest-1771769194-project Jun 16 21:21:01.584993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Jun 16 21:21:01.584993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-123472339", "metadata": {"Type": "work"}}} Jun 16 21:21:01.584993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: Jun 16 21:21:01.584993 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-123472339', 'metadata': {'Type': 'work'}}}} Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise error Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:21:01.585947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 21:21:01.587370 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 21:21:01.590110 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 21:21:01.590110 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.590110 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-de49d57d-9245-4503-9cb8-55f9b66694f7 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:21:01.590110 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-de49d57d-9245-4503-9cb8-55f9b66694f7 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.159664 Jun 16 21:21:01.590110 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 584/1138] 10.222.0.43 () {60 vars in 1155 bytes} [Thu Jun 16 21:21:01 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 21:21:01.596457 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3c4f994b-5e99-4cd6-ab7f-e09f8f1b7d32 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Action: 'create', calling method: .version_select at 0x7fb3fc0bd1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-135899640", "metadata": {"Type": "work"}}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:21:01.597327 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-caa55739-a4fb-4d53-817e-6dc4fa48a7a4 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:01.598059 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-caa55739-a4fb-4d53-817e-6dc4fa48a7a4 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3c4f994b-5e99-4cd6-ab7f-e09f8f1b7d32 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Request method failure captured: Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 119 Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq569_wjdAgwuCOb--jNZVq4dOUNT_QRjyF8yo-dBBo3uEW7LogsuDBirixVHbnsRyhaISJrHqLKDjlCerbERynI3gznGYLQrL5iFaIvwaLM6ezKCMvzWTUcazqedOu7mbJ2y2FvdZyDa8GFpUPUxuxLqP9KNSV0rA6nyp6cLk9NQuLE Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 5f786493fa40450098fa4b94b1c26214 Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:21:01.599750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:21:01.603784 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f786493fa40450098fa4b94b1c26214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5f786493fa40450098fa4b94b1c26214"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f786493fa40450098fa4b94b1c26214"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5f786493fa40450098fa4b94b1c26214"}]}] Jun 16 21:21:01.603784 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.603784 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 5f786493fa40450098fa4b94b1c26214 Jun 16 21:21:01.603784 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.603784 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-VolumesNegativeTest-1771769194-project Jun 16 21:21:01.603784 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:21:01.603784 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:21:01.603784 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 7a5d65765c6d4bb9a0e65ebf7c63370b Jun 16 21:21:01.603784 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-VolumesNegativeTest-1771769194-project Jun 16 21:21:01.603784 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Jun 16 21:21:01.603784 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-135899640", "metadata": {"Type": "work"}}} Jun 16 21:21:01.603784 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: Jun 16 21:21:01.603784 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-135899640', 'metadata': {'Type': 'work'}}}} Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise error Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi '0' Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:21:01.605844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 21:21:01.611748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 21:21:01.615124 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 21:21:01.615124 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.615124 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3c4f994b-5e99-4cd6-ab7f-e09f8f1b7d32 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:21:01.615124 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-3c4f994b-5e99-4cd6-ab7f-e09f8f1b7d32 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012965 Jun 16 21:21:01.615124 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 555/1139] 10.222.0.43 () {60 vars in 1155 bytes} [Thu Jun 16 21:21:01 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 21:21:01.616085 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-caa55739-a4fb-4d53-817e-6dc4fa48a7a4 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:01.616085 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-caa55739-a4fb-4d53-817e-6dc4fa48a7a4 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:01.616085 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-caa55739-a4fb-4d53-817e-6dc4fa48a7a4 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:01.616085 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-caa55739-a4fb-4d53-817e-6dc4fa48a7a4 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:01.619157 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-fefbbedc-29a0-4a9b-b002-4ab302c67e16 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Action: 'create', calling method: .version_select at 0x7fb3fc0b63a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-422064238", "metadata": {"Type": "work"}}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-fefbbedc-29a0-4a9b-b002-4ab302c67e16 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Request method failure captured: Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 118 Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq569_wjdAgwuCOb--jNZVq4dOUNT_QRjyF8yo-dBBo3uEW7LogsuDBirixVHbnsRyhaISJrHqLKDjlCerbERynI3gznGYLQrL5iFaIvwaLM6ezKCMvzWTUcazqedOu7mbJ2y2FvdZyDa8GFpUPUxuxLqP9KNSV0rA6nyp6cLk9NQuLE Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 5f786493fa40450098fa4b94b1c26214 Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:21:01.623420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:21:01.625044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f786493fa40450098fa4b94b1c26214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5f786493fa40450098fa4b94b1c26214"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f786493fa40450098fa4b94b1c26214"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5f786493fa40450098fa4b94b1c26214"}]}] Jun 16 21:21:01.625044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.625044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 5f786493fa40450098fa4b94b1c26214 Jun 16 21:21:01.625044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.625044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-VolumesNegativeTest-1771769194-project Jun 16 21:21:01.625044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:21:01.625044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:21:01.625044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 7a5d65765c6d4bb9a0e65ebf7c63370b Jun 16 21:21:01.625044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-VolumesNegativeTest-1771769194-project Jun 16 21:21:01.625044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Jun 16 21:21:01.625044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-422064238", "metadata": {"Type": "work"}}} Jun 16 21:21:01.625044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: Jun 16 21:21:01.625044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-422064238', 'metadata': {'Type': 'work'}}}} Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise error Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi '' Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:21:01.626030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 21:21:01.628080 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 21:21:01.629969 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 21:21:01.629969 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.629969 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-fefbbedc-29a0-4a9b-b002-4ab302c67e16 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:21:01.629969 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-fefbbedc-29a0-4a9b-b002-4ab302c67e16 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013708 Jun 16 21:21:01.629969 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 556/1140] 10.222.0.43 () {60 vars in 1155 bytes} [Thu Jun 16 21:21:01 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 21:21:01.642852 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d964ec9f-10d0-4ee6-89d3-50b8cfe07c05 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Calling method '.version_select at 0x7fb3fc0dfca0>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:01.679125 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-d964ec9f-10d0-4ee6-89d3-50b8cfe07c05 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] HTTP exception thrown: Volume tempest-invalid-587575539 could not be found. Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d964ec9f-10d0-4ee6-89d3-50b8cfe07c05 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Request method failure captured: Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-587575539 HTTP/1.1 Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq569_wjdAgwuCOb--jNZVq4dOUNT_QRjyF8yo-dBBo3uEW7LogsuDBirixVHbnsRyhaISJrHqLKDjlCerbERynI3gznGYLQrL5iFaIvwaLM6ezKCMvzWTUcazqedOu7mbJ2y2FvdZyDa8GFpUPUxuxLqP9KNSV0rA6nyp6cLk9NQuLE Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 5f786493fa40450098fa4b94b1c26214 Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:21:01.681186 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:21:01.682547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f786493fa40450098fa4b94b1c26214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5f786493fa40450098fa4b94b1c26214"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f786493fa40450098fa4b94b1c26214"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5f786493fa40450098fa4b94b1c26214"}]}] Jun 16 21:21:01.682547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.682547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 5f786493fa40450098fa4b94b1c26214 Jun 16 21:21:01.682547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.682547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-VolumesNegativeTest-1771769194-project Jun 16 21:21:01.682547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:21:01.682547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:21:01.682547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 7a5d65765c6d4bb9a0e65ebf7c63370b Jun 16 21:21:01.682547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-VolumesNegativeTest-1771769194-project Jun 16 21:21:01.682547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: Jun 16 21:21:01.682547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Volume tempest-invalid-587575539 could not be found. Jun 16 21:21:01.682547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': 'tempest-invalid-587575539'} Jun 16 21:21:01.682547 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-587575539 could not be found. (HTTP 404) (Request-ID: req-4d6961ab-7ead-4003-bb46-442c21ee1aa4) Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:01.683716 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 21:21:01.685079 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-587575539 could not be found. Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:21:01.686735 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-587575539 could not be found. Jun 16 21:21:01.689879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.689879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:01.689879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.689879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.689879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:21:01.689879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:21:01.689879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:21:01.689879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:21:01.689879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-587575539 could not be found. Jun 16 21:21:01.689879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.689879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d964ec9f-10d0-4ee6-89d3-50b8cfe07c05 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Returning 404 to user: Volume tempest-invalid-587575539 could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:21:01.689879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d964ec9f-10d0-4ee6-89d3-50b8cfe07c05 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-587575539" status: 404 len: 98 microversion: 2.1 time: 0.051433 Jun 16 21:21:01.689879 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 557/1141] 10.222.0.43 () {58 vars in 1214 bytes} [Thu Jun 16 21:21:01 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-587575539 => generated 98 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 21:21:01.693570 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-32ccc516-a851-43b8-ac4a-db640d3fd485 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004543 Jun 16 21:21:01.694082 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 558/1142] 10.222.0.43 () {58 vars in 1139 bytes} [Thu Jun 16 21:21:01 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 16 21:21:01.703822 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4e39c7e1-bba5-49a0-b5ca-88c282b8cd74 tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003599 Jun 16 21:21:01.708222 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 559/1143] 10.222.0.43 () {58 vars in 1136 bytes} [Thu Jun 16 21:21:01 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 21:21:01.713600 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0ca161f2-25d8-45aa-9863-55ebeba8e51a tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Calling method '.version_select at 0x7fb3fc0c89d0>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:01.749819 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-0ca161f2-25d8-45aa-9863-55ebeba8e51a tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] HTTP exception thrown: Volume 1d9bc914-abd4-41d8-ab83-70e4ec2d3588 could not be found. Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0ca161f2-25d8-45aa-9863-55ebeba8e51a tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Request method failure captured: Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: DELETE /compute/v2.1/os-volumes/1d9bc914-abd4-41d8-ab83-70e4ec2d3588 HTTP/1.1 Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq569_wjdAgwuCOb--jNZVq4dOUNT_QRjyF8yo-dBBo3uEW7LogsuDBirixVHbnsRyhaISJrHqLKDjlCerbERynI3gznGYLQrL5iFaIvwaLM6ezKCMvzWTUcazqedOu7mbJ2y2FvdZyDa8GFpUPUxuxLqP9KNSV0rA6nyp6cLk9NQuLE Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 5f786493fa40450098fa4b94b1c26214 Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:21:01.752032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:21:01.753727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f786493fa40450098fa4b94b1c26214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5f786493fa40450098fa4b94b1c26214"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f786493fa40450098fa4b94b1c26214"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5f786493fa40450098fa4b94b1c26214"}]}] Jun 16 21:21:01.753727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.753727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 5f786493fa40450098fa4b94b1c26214 Jun 16 21:21:01.753727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.753727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-VolumesNegativeTest-1771769194-project Jun 16 21:21:01.753727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:21:01.753727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:21:01.753727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 7a5d65765c6d4bb9a0e65ebf7c63370b Jun 16 21:21:01.753727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-VolumesNegativeTest-1771769194-project Jun 16 21:21:01.753727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: Jun 16 21:21:01.753727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Volume 1d9bc914-abd4-41d8-ab83-70e4ec2d3588 could not be found. Jun 16 21:21:01.753727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '1d9bc914-abd4-41d8-ab83-70e4ec2d3588'} Jun 16 21:21:01.753727 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d9bc914-abd4-41d8-ab83-70e4ec2d3588 could not be found. (HTTP 404) (Request-ID: req-da1d9c77-54b6-4f1c-8a04-cdf1b4ac8552) Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:01.756075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 21:21:01.758403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d9bc914-abd4-41d8-ab83-70e4ec2d3588 could not be found. Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 21:21:01.760474 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:21:01.762092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d9bc914-abd4-41d8-ab83-70e4ec2d3588 could not be found. Jun 16 21:21:01.762092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.762092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:01.762092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.762092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.762092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:21:01.762092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:21:01.762092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:21:01.762092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:21:01.762092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d9bc914-abd4-41d8-ab83-70e4ec2d3588 could not be found. Jun 16 21:21:01.762092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.762092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0ca161f2-25d8-45aa-9863-55ebeba8e51a tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Returning 404 to user: Volume 1d9bc914-abd4-41d8-ab83-70e4ec2d3588 could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:21:01.762092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0ca161f2-25d8-45aa-9863-55ebeba8e51a tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/1d9bc914-abd4-41d8-ab83-70e4ec2d3588" status: 404 len: 109 microversion: 2.1 time: 0.050079 Jun 16 21:21:01.762092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 560/1144] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 16 21:21:01 2022] DELETE /compute/v2.1/os-volumes/1d9bc914-abd4-41d8-ab83-70e4ec2d3588 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:21:01.771695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-27884676-61a7-47bf-9d60-9ff74b54995d tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Calling method '.version_select at 0x7fb3f75999d0>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:01.803310 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-27884676-61a7-47bf-9d60-9ff74b54995d tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] HTTP exception thrown: Volume 8e7031cf-fb83-42de-8bae-f685e4e1565e could not be found. Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-27884676-61a7-47bf-9d60-9ff74b54995d tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Request method failure captured: Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/os-volumes/8e7031cf-fb83-42de-8bae-f685e4e1565e HTTP/1.1 Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq569_wjdAgwuCOb--jNZVq4dOUNT_QRjyF8yo-dBBo3uEW7LogsuDBirixVHbnsRyhaISJrHqLKDjlCerbERynI3gznGYLQrL5iFaIvwaLM6ezKCMvzWTUcazqedOu7mbJ2y2FvdZyDa8GFpUPUxuxLqP9KNSV0rA6nyp6cLk9NQuLE Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 5f786493fa40450098fa4b94b1c26214 Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:21:01.805257 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:21:01.806624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f786493fa40450098fa4b94b1c26214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5f786493fa40450098fa4b94b1c26214"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5f786493fa40450098fa4b94b1c26214"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5f786493fa40450098fa4b94b1c26214"}]}] Jun 16 21:21:01.806624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.806624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 5f786493fa40450098fa4b94b1c26214 Jun 16 21:21:01.806624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-VolumesNegativeTest-1771769194 Jun 16 21:21:01.806624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-VolumesNegativeTest-1771769194-project Jun 16 21:21:01.806624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:21:01.806624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:21:01.806624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 7a5d65765c6d4bb9a0e65ebf7c63370b Jun 16 21:21:01.806624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-VolumesNegativeTest-1771769194-project Jun 16 21:21:01.806624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: Jun 16 21:21:01.806624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Volume 8e7031cf-fb83-42de-8bae-f685e4e1565e could not be found. Jun 16 21:21:01.806624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '8e7031cf-fb83-42de-8bae-f685e4e1565e'} Jun 16 21:21:01.806624 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8e7031cf-fb83-42de-8bae-f685e4e1565e could not be found. (HTTP 404) (Request-ID: req-34fb5115-08e6-4f9b-a955-a7cfe1550203) Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:01.807681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 21:21:01.809121 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8e7031cf-fb83-42de-8bae-f685e4e1565e could not be found. Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 21:21:01.810258 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:21:01.811462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8e7031cf-fb83-42de-8bae-f685e4e1565e could not be found. Jun 16 21:21:01.811462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.811462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:01.811462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.811462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:01.811462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:21:01.811462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:21:01.811462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:21:01.811462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:21:01.811462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8e7031cf-fb83-42de-8bae-f685e4e1565e could not be found. Jun 16 21:21:01.811462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:21:01.811462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-27884676-61a7-47bf-9d60-9ff74b54995d tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] Returning 404 to user: Volume 8e7031cf-fb83-42de-8bae-f685e4e1565e could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:21:01.811462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-27884676-61a7-47bf-9d60-9ff74b54995d tempest-VolumesNegativeTest-1771769194 tempest-VolumesNegativeTest-1771769194-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/8e7031cf-fb83-42de-8bae-f685e4e1565e" status: 404 len: 109 microversion: 2.1 time: 0.041039 Jun 16 21:21:01.811462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 561/1145] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 16 21:21:01 2022] GET /compute/v2.1/os-volumes/8e7031cf-fb83-42de-8bae-f685e4e1565e => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:21:01.838260 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-caa55739-a4fb-4d53-817e-6dc4fa48a7a4 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:01.845634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-caa55739-a4fb-4d53-817e-6dc4fa48a7a4 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1497 microversion: 2.1 time: 0.252849 Jun 16 21:21:01.846190 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 585/1146] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:01 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1497 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:02.085399 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5eeefac4-a7c7-4f33-aa17-23b40d60ddae tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:02.086082 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5eeefac4-a7c7-4f33-aa17-23b40d60ddae tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:02.100982 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5eeefac4-a7c7-4f33-aa17-23b40d60ddae tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:02.101576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5eeefac4-a7c7-4f33-aa17-23b40d60ddae tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:02.102761 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5eeefac4-a7c7-4f33-aa17-23b40d60ddae tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:02.103671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5eeefac4-a7c7-4f33-aa17-23b40d60ddae tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:02.278548 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5eeefac4-a7c7-4f33-aa17-23b40d60ddae tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:02.287190 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5eeefac4-a7c7-4f33-aa17-23b40d60ddae tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.207867 Jun 16 21:21:02.288068 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 562/1147] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:02 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:21:03.304963 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-1f98fa77-6911-4270-aa47-f216d51ccb26 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:03.305581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-1f98fa77-6911-4270-aa47-f216d51ccb26 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:03.312165 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1f98fa77-6911-4270-aa47-f216d51ccb26 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:03.312712 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1f98fa77-6911-4270-aa47-f216d51ccb26 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:03.313477 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1f98fa77-6911-4270-aa47-f216d51ccb26 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:03.313908 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-1f98fa77-6911-4270-aa47-f216d51ccb26 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:03.484789 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-1f98fa77-6911-4270-aa47-f216d51ccb26 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:03.494669 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-1f98fa77-6911-4270-aa47-f216d51ccb26 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.194263 Jun 16 21:21:03.495260 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 586/1148] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:03 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:04.512975 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6e75832a-b890-4f22-bb69-d5c79e36f4f2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:04.513584 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6e75832a-b890-4f22-bb69-d5c79e36f4f2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:04.519842 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6e75832a-b890-4f22-bb69-d5c79e36f4f2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:04.520983 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6e75832a-b890-4f22-bb69-d5c79e36f4f2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:04.522030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6e75832a-b890-4f22-bb69-d5c79e36f4f2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:04.522461 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6e75832a-b890-4f22-bb69-d5c79e36f4f2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:04.719513 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6e75832a-b890-4f22-bb69-d5c79e36f4f2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:04.724914 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-18c44eb7-6fe6-4ade-83cb-de44c0d5fb32 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:04.726359 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-18c44eb7-6fe6-4ade-83cb-de44c0d5fb32 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:04.729357 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6e75832a-b890-4f22-bb69-d5c79e36f4f2 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.220129 Jun 16 21:21:04.730201 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 563/1149] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:04 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:04.743789 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-18c44eb7-6fe6-4ade-83cb-de44c0d5fb32 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:04.756824 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-18c44eb7-6fe6-4ade-83cb-de44c0d5fb32 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:04.757973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-18c44eb7-6fe6-4ade-83cb-de44c0d5fb32 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:04.758635 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-18c44eb7-6fe6-4ade-83cb-de44c0d5fb32 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:04.804613 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-18c44eb7-6fe6-4ade-83cb-de44c0d5fb32 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Going to try to terminate instance {{(pid=117737) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:21:04.917605 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-18c44eb7-6fe6-4ade-83cb-de44c0d5fb32 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "DELETE /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 204 len: 0 microversion: 2.1 time: 0.196639 Jun 16 21:21:04.919233 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 587/1150] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:21:04 2022] DELETE /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:21:04.929709 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-cd22d1eb-ab46-4ecf-a3a6-16973d89553f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:04.930871 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-cd22d1eb-ab46-4ecf-a3a6-16973d89553f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:04.941386 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cd22d1eb-ab46-4ecf-a3a6-16973d89553f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:04.942354 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cd22d1eb-ab46-4ecf-a3a6-16973d89553f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:04.943424 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cd22d1eb-ab46-4ecf-a3a6-16973d89553f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:04.944071 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-cd22d1eb-ab46-4ecf-a3a6-16973d89553f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:05.075922 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-cd22d1eb-ab46-4ecf-a3a6-16973d89553f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:05.083461 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-cd22d1eb-ab46-4ecf-a3a6-16973d89553f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1503 microversion: 2.1 time: 0.159356 Jun 16 21:21:05.084030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 564/1151] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:04 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:05.747829 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e8355d52-66dc-44ec-999f-247c5b5bce66 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:05.748477 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e8355d52-66dc-44ec-999f-247c5b5bce66 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:05.755284 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e8355d52-66dc-44ec-999f-247c5b5bce66 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:05.755748 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e8355d52-66dc-44ec-999f-247c5b5bce66 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:05.756547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e8355d52-66dc-44ec-999f-247c5b5bce66 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:05.756981 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e8355d52-66dc-44ec-999f-247c5b5bce66 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:05.899205 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e8355d52-66dc-44ec-999f-247c5b5bce66 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:05.908425 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e8355d52-66dc-44ec-999f-247c5b5bce66 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.165162 Jun 16 21:21:05.908990 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 588/1152] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:05 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:06.101575 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-78dbc880-a4af-4576-bf9b-6945b83ccfa0 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:06.102191 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-78dbc880-a4af-4576-bf9b-6945b83ccfa0 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:06.108591 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-78dbc880-a4af-4576-bf9b-6945b83ccfa0 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:06.109044 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-78dbc880-a4af-4576-bf9b-6945b83ccfa0 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:06.109817 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-78dbc880-a4af-4576-bf9b-6945b83ccfa0 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:06.110256 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-78dbc880-a4af-4576-bf9b-6945b83ccfa0 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:06.251418 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-78dbc880-a4af-4576-bf9b-6945b83ccfa0 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:06.260354 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-78dbc880-a4af-4576-bf9b-6945b83ccfa0 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1503 microversion: 2.1 time: 0.163187 Jun 16 21:21:06.260916 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 565/1153] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:06 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:21:06.832293 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-5aee7a59-ef7e-40d1-8f91-432f0696e3d6 req-36be14a4-5696-4b5b-8082-088c165aced4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334a1b5b-c324-4952-9875-f93b251a544c", "name": "network-vif-plugged", "status": "completed", "tag": "a184de69-92f7-4829-83d3-e946b229e004"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:21:06.848838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-5aee7a59-ef7e-40d1-8f91-432f0696e3d6 req-36be14a4-5696-4b5b-8082-088c165aced4 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:06.850230 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-5aee7a59-ef7e-40d1-8f91-432f0696e3d6 req-36be14a4-5696-4b5b-8082-088c165aced4 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:06.868927 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-5aee7a59-ef7e-40d1-8f91-432f0696e3d6 req-36be14a4-5696-4b5b-8082-088c165aced4 service nova] Creating event network-vif-plugged:a184de69-92f7-4829-83d3-e946b229e004 for instance 334a1b5b-c324-4952-9875-f93b251a544c on hv-cinder-81914 Jun 16 21:21:06.874693 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-5aee7a59-ef7e-40d1-8f91-432f0696e3d6 req-36be14a4-5696-4b5b-8082-088c165aced4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047112 Jun 16 21:21:06.875586 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 589/1154] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:21:06.935094 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d966b1b3-b9fb-4ed3-a5be-b4fee09718e0 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:06.936493 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d966b1b3-b9fb-4ed3-a5be-b4fee09718e0 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:06.943581 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d966b1b3-b9fb-4ed3-a5be-b4fee09718e0 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:06.944085 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d966b1b3-b9fb-4ed3-a5be-b4fee09718e0 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:06.944935 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d966b1b3-b9fb-4ed3-a5be-b4fee09718e0 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:06.945453 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d966b1b3-b9fb-4ed3-a5be-b4fee09718e0 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:07.158092 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d966b1b3-b9fb-4ed3-a5be-b4fee09718e0 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:07.171252 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d966b1b3-b9fb-4ed3-a5be-b4fee09718e0 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.240799 Jun 16 21:21:07.182377 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 566/1155] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:06 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:07.278397 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ce756abc-8940-4ad0-a097-fca582c34ffd tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:07.279100 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ce756abc-8940-4ad0-a097-fca582c34ffd tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:07.282127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:07.286999 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ce756abc-8940-4ad0-a097-fca582c34ffd tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:07.287450 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ce756abc-8940-4ad0-a097-fca582c34ffd tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:07.288262 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ce756abc-8940-4ad0-a097-fca582c34ffd tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:07.288706 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-ce756abc-8940-4ad0-a097-fca582c34ffd tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:07.299238 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-0960362f-ac56-4c6f-aabe-c1fba577699c req-d5506f81-bab4-4609-96d7-79194b810ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "660282bd-fd1d-4994-a613-a8a906f79462", "name": "network-vif-deleted", "tag": "c76974f7-fb59-4c9f-9616-e5a93348d596"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:21:07.312100 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-0960362f-ac56-4c6f-aabe-c1fba577699c req-d5506f81-bab4-4609-96d7-79194b810ef3 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:07.312857 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-0960362f-ac56-4c6f-aabe-c1fba577699c req-d5506f81-bab4-4609-96d7-79194b810ef3 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:07.330759 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-0960362f-ac56-4c6f-aabe-c1fba577699c req-d5506f81-bab4-4609-96d7-79194b810ef3 service nova] Creating event network-vif-deleted:c76974f7-fb59-4c9f-9616-e5a93348d596 for instance 660282bd-fd1d-4994-a613-a8a906f79462 on hv-cinder-81914 Jun 16 21:21:07.338301 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-0960362f-ac56-4c6f-aabe-c1fba577699c req-d5506f81-bab4-4609-96d7-79194b810ef3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043343 Jun 16 21:21:07.339102 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 567/1156] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:21:07.369977 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-ce756abc-8940-4ad0-a097-fca582c34ffd tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:07.377864 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ce756abc-8940-4ad0-a097-fca582c34ffd tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1461 microversion: 2.1 time: 0.103692 Jun 16 21:21:07.378439 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 590/1157] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:07 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1461 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:08.192058 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-9a3fec2b-f10c-491b-a9a7-771f67138eb6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:08.193697 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-9a3fec2b-f10c-491b-a9a7-771f67138eb6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:08.199616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9a3fec2b-f10c-491b-a9a7-771f67138eb6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:08.200031 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9a3fec2b-f10c-491b-a9a7-771f67138eb6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:08.201045 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9a3fec2b-f10c-491b-a9a7-771f67138eb6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:08.201482 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-9a3fec2b-f10c-491b-a9a7-771f67138eb6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:08.392030 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-9a3fec2b-f10c-491b-a9a7-771f67138eb6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:08.396863 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5a12aad8-d3fa-4a80-a76a-16df1c654f69 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:08.397550 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5a12aad8-d3fa-4a80-a76a-16df1c654f69 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:08.424695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-9a3fec2b-f10c-491b-a9a7-771f67138eb6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1265 microversion: 2.1 time: 0.235101 Jun 16 21:21:08.427808 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 568/1158] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:08 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:08.429223 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5a12aad8-d3fa-4a80-a76a-16df1c654f69 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:08.430012 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5a12aad8-d3fa-4a80-a76a-16df1c654f69 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:08.430787 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5a12aad8-d3fa-4a80-a76a-16df1c654f69 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:08.431213 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5a12aad8-d3fa-4a80-a76a-16df1c654f69 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:08.503986 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5a12aad8-d3fa-4a80-a76a-16df1c654f69 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:08.505023 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5a12aad8-d3fa-4a80-a76a-16df1c654f69 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:08.507837 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.objects.instance [None req-5a12aad8-d3fa-4a80-a76a-16df1c654f69 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lazy-loading 'fault' on Instance uuid 660282bd-fd1d-4994-a613-a8a906f79462 {{(pid=117737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:21:08.579931 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-5a12aad8-d3fa-4a80-a76a-16df1c654f69 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:08.589884 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5a12aad8-d3fa-4a80-a76a-16df1c654f69 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 200 len: 1303 microversion: 2.1 time: 0.198735 Jun 16 21:21:08.601375 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 591/1159] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:08 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 1303 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:21:09.448643 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-33de92e7-1185-4065-b425-5ea10984b4f5 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:09.448643 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-33de92e7-1185-4065-b425-5ea10984b4f5 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:09.474649 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-33de92e7-1185-4065-b425-5ea10984b4f5 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:09.475259 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-33de92e7-1185-4065-b425-5ea10984b4f5 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:09.476102 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-33de92e7-1185-4065-b425-5ea10984b4f5 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:09.476573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-33de92e7-1185-4065-b425-5ea10984b4f5 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:09.608556 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-083e05aa-da8f-44fc-b8f5-29795b047677 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:09.609936 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-083e05aa-da8f-44fc-b8f5-29795b047677 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: 660282bd-fd1d-4994-a613-a8a906f79462] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:09.621511 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-083e05aa-da8f-44fc-b8f5-29795b047677 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:09.628950 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-083e05aa-da8f-44fc-b8f5-29795b047677 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:09.632272 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-083e05aa-da8f-44fc-b8f5-29795b047677 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:09.633314 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-083e05aa-da8f-44fc-b8f5-29795b047677 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:09.653795 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-083e05aa-da8f-44fc-b8f5-29795b047677 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] HTTP exception thrown: Instance 660282bd-fd1d-4994-a613-a8a906f79462 could not be found. Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-083e05aa-da8f-44fc-b8f5-29795b047677 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Request method failure captured: Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 HTTP/1.1 Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq56oGT3bW0dOdyrTiEcQwHFw8l2xxsIWEX1JcrGTz4glUYCfqZ6C1tq7RFibpysJrdEWnHcAizYjRka7K--bfyjx8bPVqyqDlM9hPdvdAQnj4ag9CnGWR2QLp5FvHClUHyZYKUpCkhGb7QXmvu5MBCPqH6lICxfELZBEOWdYSybApCU Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 404175dcaa0144fab98ad34e4834de35 Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-VolumesActionsTest-1533059177 Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:21:09.656024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:21:09.657634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/404175dcaa0144fab98ad34e4834de35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_404175dcaa0144fab98ad34e4834de35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/404175dcaa0144fab98ad34e4834de35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/404175dcaa0144fab98ad34e4834de35"}]}] Jun 16 21:21:09.657634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-VolumesActionsTest-1533059177 Jun 16 21:21:09.657634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 404175dcaa0144fab98ad34e4834de35 Jun 16 21:21:09.657634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-VolumesActionsTest-1533059177 Jun 16 21:21:09.657634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-VolumesActionsTest-1533059177-project Jun 16 21:21:09.657634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:21:09.657634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:21:09.657634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 105646575b4748a88700db4117174c0c Jun 16 21:21:09.657634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-VolumesActionsTest-1533059177-project Jun 16 21:21:09.657634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:21:09.657634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 660282bd-fd1d-4994-a613-a8a906f79462 could not be found. Jun 16 21:21:09.657634 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '660282bd-fd1d-4994-a613-a8a906f79462'} Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 660282bd-fd1d-4994-a613-a8a906f79462 could not be found. Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:21:09.658531 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 660282bd-fd1d-4994-a613-a8a906f79462 could not be found. Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 660282bd-fd1d-4994-a613-a8a906f79462 could not be found. Jun 16 21:21:09.660792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:09.664484 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-083e05aa-da8f-44fc-b8f5-29795b047677 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Returning 404 to user: Instance 660282bd-fd1d-4994-a613-a8a906f79462 could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:21:09.665558 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-083e05aa-da8f-44fc-b8f5-29795b047677 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462" status: 404 len: 111 microversion: 2.1 time: 0.062231 Jun 16 21:21:09.666944 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 592/1160] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:09 2022] GET /compute/v2.1/servers/660282bd-fd1d-4994-a613-a8a906f79462 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:21:09.682458 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-33de92e7-1185-4065-b425-5ea10984b4f5 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:09.690077 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-33de92e7-1185-4065-b425-5ea10984b4f5 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1452 microversion: 2.1 time: 0.251681 Jun 16 21:21:09.691082 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 569/1161] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:09 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1452 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:09.707624 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-0736fd48-4f4b-497c-859a-a681ebaed597 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:09.708578 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-0736fd48-4f4b-497c-859a-a681ebaed597 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:09.722289 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0736fd48-4f4b-497c-859a-a681ebaed597 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:09.722720 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0736fd48-4f4b-497c-859a-a681ebaed597 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:09.723525 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0736fd48-4f4b-497c-859a-a681ebaed597 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:09.724052 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-0736fd48-4f4b-497c-859a-a681ebaed597 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:09.904268 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d5796a28-de6f-4ae9-b3c3-478353a55534 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1961918193", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452", "networks": [{"uuid": "91b7ccee-e055-4907-b88a-7403ae972460"}]}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:21:09.912166 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:09.974885 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.network.neutron [None req-d5796a28-de6f-4ae9-b3c3-478353a55534 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] validate_networks() for [('91b7ccee-e055-4907-b88a-7403ae972460', None, None, None, None, None)] {{(pid=117738) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:21:10.011149 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-0736fd48-4f4b-497c-859a-a681ebaed597 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:10.019893 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-0736fd48-4f4b-497c-859a-a681ebaed597 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1452 microversion: 2.1 time: 0.316222 Jun 16 21:21:10.021792 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 593/1162] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:09 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1452 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:10.484007 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-d5796a28-de6f-4ae9-b3c3-478353a55534 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Flavor limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:21:10.484536 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-d5796a28-de6f-4ae9-b3c3-478353a55534 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Image limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:21:10.485067 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-d5796a28-de6f-4ae9-b3c3-478353a55534 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Flavor pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:21:10.485973 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-d5796a28-de6f-4ae9-b3c3-478353a55534 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Image pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:21:10.486476 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-d5796a28-de6f-4ae9-b3c3-478353a55534 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:21:10.501101 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d5796a28-de6f-4ae9-b3c3-478353a55534 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:10.501101 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d5796a28-de6f-4ae9-b3c3-478353a55534 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:10.501401 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d5796a28-de6f-4ae9-b3c3-478353a55534 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:10.501712 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d5796a28-de6f-4ae9-b3c3-478353a55534 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:10.534237 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-d5796a28-de6f-4ae9-b3c3-478353a55534 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Getting quotas for project 404175dcaa0144fab98ad34e4834de35. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:21:10.545774 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-d5796a28-de6f-4ae9-b3c3-478353a55534 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Getting quotas for user 105646575b4748a88700db4117174c0c and project 404175dcaa0144fab98ad34e4834de35. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:21:10.559877 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d5796a28-de6f-4ae9-b3c3-478353a55534 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Going to run 1 instances... {{(pid=117738) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:21:10.562460 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d5796a28-de6f-4ae9-b3c3-478353a55534 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:21:10.643680 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d5796a28-de6f-4ae9-b3c3-478353a55534 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744471 Jun 16 21:21:10.644843 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 570/1163] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:21:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 21:21:10.657717 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-28a6e991-96b4-4269-9a2c-f58aa8bb4521 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:10.659217 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-28a6e991-96b4-4269-9a2c-f58aa8bb4521 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:10.749366 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-28a6e991-96b4-4269-9a2c-f58aa8bb4521 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:10.758229 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-28a6e991-96b4-4269-9a2c-f58aa8bb4521 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0" status: 200 len: 1214 microversion: 2.1 time: 0.106835 Jun 16 21:21:10.758806 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 594/1164] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:10 2022] GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:11.776526 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-55daf503-79e3-47bf-ae2b-749aea0e752a tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:11.777514 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-55daf503-79e3-47bf-ae2b-749aea0e752a tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:11.790730 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-55daf503-79e3-47bf-ae2b-749aea0e752a tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:11.791994 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-55daf503-79e3-47bf-ae2b-749aea0e752a tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:11.793067 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-55daf503-79e3-47bf-ae2b-749aea0e752a tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:11.793924 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-55daf503-79e3-47bf-ae2b-749aea0e752a tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:11.826935 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=100 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:11.908060 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-55daf503-79e3-47bf-ae2b-749aea0e752a tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:11.921242 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-55daf503-79e3-47bf-ae2b-749aea0e752a tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0" status: 200 len: 1266 microversion: 2.1 time: 0.147154 Jun 16 21:21:11.923796 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 571/1165] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:11 2022] GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:12.945709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-2b06e0dc-3741-4d51-9fd5-0af3cb9f8f26 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:12.950211 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-2b06e0dc-3741-4d51-9fd5-0af3cb9f8f26 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:12.961151 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2b06e0dc-3741-4d51-9fd5-0af3cb9f8f26 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:12.962407 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2b06e0dc-3741-4d51-9fd5-0af3cb9f8f26 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:12.964246 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2b06e0dc-3741-4d51-9fd5-0af3cb9f8f26 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:12.964886 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-2b06e0dc-3741-4d51-9fd5-0af3cb9f8f26 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:13.073966 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-2b06e0dc-3741-4d51-9fd5-0af3cb9f8f26 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:13.081776 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-2b06e0dc-3741-4d51-9fd5-0af3cb9f8f26 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0" status: 200 len: 1272 microversion: 2.1 time: 0.144586 Jun 16 21:21:13.082529 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 595/1166] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:12 2022] GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0 => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:13.893200 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-c0b39039-79e4-4bf5-a943-61ccf60effc3 req-9793d3cc-f9d5-4905-897e-a5688de244a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "334a1b5b-c324-4952-9875-f93b251a544c", "tag": "a184de69-92f7-4829-83d3-e946b229e004"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:21:13.911011 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-c0b39039-79e4-4bf5-a943-61ccf60effc3 req-9793d3cc-f9d5-4905-897e-a5688de244a5 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:13.911565 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-c0b39039-79e4-4bf5-a943-61ccf60effc3 req-9793d3cc-f9d5-4905-897e-a5688de244a5 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:13.958926 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-c0b39039-79e4-4bf5-a943-61ccf60effc3 req-9793d3cc-f9d5-4905-897e-a5688de244a5 service nova] Creating event network-changed:a184de69-92f7-4829-83d3-e946b229e004 for instance 334a1b5b-c324-4952-9875-f93b251a544c on hv-cinder-81914 Jun 16 21:21:13.966420 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-c0b39039-79e4-4bf5-a943-61ccf60effc3 req-9793d3cc-f9d5-4905-897e-a5688de244a5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076827 Jun 16 21:21:13.967585 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 572/1167] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:21:14.099612 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-acaa345d-aa9c-4e54-9fe8-401288e9cfc9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:14.100447 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-acaa345d-aa9c-4e54-9fe8-401288e9cfc9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:14.111410 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-acaa345d-aa9c-4e54-9fe8-401288e9cfc9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:14.111874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-acaa345d-aa9c-4e54-9fe8-401288e9cfc9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:14.115328 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-acaa345d-aa9c-4e54-9fe8-401288e9cfc9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:14.115764 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-acaa345d-aa9c-4e54-9fe8-401288e9cfc9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:14.543247 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-acaa345d-aa9c-4e54-9fe8-401288e9cfc9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:14.553848 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-acaa345d-aa9c-4e54-9fe8-401288e9cfc9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0" status: 200 len: 1314 microversion: 2.1 time: 0.458871 Jun 16 21:21:14.555156 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 596/1168] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:14 2022] GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:15.572415 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c217d42b-9207-4998-bd2c-a0f915a73219 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:15.573739 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c217d42b-9207-4998-bd2c-a0f915a73219 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:15.579827 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c217d42b-9207-4998-bd2c-a0f915a73219 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:15.580476 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c217d42b-9207-4998-bd2c-a0f915a73219 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:15.581275 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c217d42b-9207-4998-bd2c-a0f915a73219 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:15.581704 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c217d42b-9207-4998-bd2c-a0f915a73219 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:15.773360 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c217d42b-9207-4998-bd2c-a0f915a73219 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:15.782923 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c217d42b-9207-4998-bd2c-a0f915a73219 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0" status: 200 len: 1314 microversion: 2.1 time: 0.215761 Jun 16 21:21:15.783594 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 573/1169] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:15 2022] GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:16.021562 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-193ba621-c417-409c-a4eb-da302436651d req-eb0c48b5-b801-4ebf-9920-c51cece8ef22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e63ee3-36a5-4577-a955-a8b681d882c0", "tag": "98a0cd33-3461-49cd-b20d-682e82acabc0"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:21:16.041788 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-193ba621-c417-409c-a4eb-da302436651d req-eb0c48b5-b801-4ebf-9920-c51cece8ef22 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:16.042230 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-193ba621-c417-409c-a4eb-da302436651d req-eb0c48b5-b801-4ebf-9920-c51cece8ef22 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:16.046161 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:16.054422 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-193ba621-c417-409c-a4eb-da302436651d req-eb0c48b5-b801-4ebf-9920-c51cece8ef22 service nova] Creating event network-changed:98a0cd33-3461-49cd-b20d-682e82acabc0 for instance a2e63ee3-36a5-4577-a955-a8b681d882c0 on hv-cinder-81914 Jun 16 21:21:16.060027 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-193ba621-c417-409c-a4eb-da302436651d req-eb0c48b5-b801-4ebf-9920-c51cece8ef22 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047790 Jun 16 21:21:16.060877 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 597/1170] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:21:16.799903 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b2d32eb1-8803-43f3-acf4-0e86b11ca56f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:16.800402 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b2d32eb1-8803-43f3-acf4-0e86b11ca56f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:16.810023 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b2d32eb1-8803-43f3-acf4-0e86b11ca56f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:16.810476 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b2d32eb1-8803-43f3-acf4-0e86b11ca56f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:16.811260 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b2d32eb1-8803-43f3-acf4-0e86b11ca56f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:16.814294 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b2d32eb1-8803-43f3-acf4-0e86b11ca56f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:17.021104 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b2d32eb1-8803-43f3-acf4-0e86b11ca56f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:17.039983 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b2d32eb1-8803-43f3-acf4-0e86b11ca56f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0" status: 200 len: 1314 microversion: 2.1 time: 0.242685 Jun 16 21:21:17.040626 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 574/1171] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:16 2022] GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:18.060745 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-dcb89992-4d21-4144-b405-e59cb8f9843b tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:18.062744 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-dcb89992-4d21-4144-b405-e59cb8f9843b tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:18.075707 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dcb89992-4d21-4144-b405-e59cb8f9843b tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:18.076201 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dcb89992-4d21-4144-b405-e59cb8f9843b tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:18.076990 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dcb89992-4d21-4144-b405-e59cb8f9843b tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:18.077415 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-dcb89992-4d21-4144-b405-e59cb8f9843b tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:18.265279 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-dcb89992-4d21-4144-b405-e59cb8f9843b tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:18.273544 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-dcb89992-4d21-4144-b405-e59cb8f9843b tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0" status: 200 len: 1314 microversion: 2.1 time: 0.219114 Jun 16 21:21:18.283129 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 598/1172] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:18 2022] GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:19.291776 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d2a25428-486c-4971-b2fe-ff52835c2690 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:19.293077 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d2a25428-486c-4971-b2fe-ff52835c2690 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:19.300737 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d2a25428-486c-4971-b2fe-ff52835c2690 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:19.301856 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d2a25428-486c-4971-b2fe-ff52835c2690 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:19.302826 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d2a25428-486c-4971-b2fe-ff52835c2690 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:19.303252 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d2a25428-486c-4971-b2fe-ff52835c2690 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:19.446723 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d2a25428-486c-4971-b2fe-ff52835c2690 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:19.454450 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d2a25428-486c-4971-b2fe-ff52835c2690 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0" status: 200 len: 1314 microversion: 2.1 time: 0.168205 Jun 16 21:21:19.454958 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 575/1173] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:19 2022] GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:20.472944 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d90897d7-861c-41b3-aa38-1efa37630bde tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:20.475269 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d90897d7-861c-41b3-aa38-1efa37630bde tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:20.490606 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d90897d7-861c-41b3-aa38-1efa37630bde tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:20.491052 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d90897d7-861c-41b3-aa38-1efa37630bde tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:20.492024 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d90897d7-861c-41b3-aa38-1efa37630bde tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:20.492929 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d90897d7-861c-41b3-aa38-1efa37630bde tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:20.712548 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d90897d7-861c-41b3-aa38-1efa37630bde tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:20.724798 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d90897d7-861c-41b3-aa38-1efa37630bde tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0" status: 200 len: 1314 microversion: 2.1 time: 0.255287 Jun 16 21:21:20.726480 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 599/1174] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:20 2022] GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:20.860054 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-52d59eea-2c8c-45a0-9ca8-5f6a236da2d3 req-d8e09105-8eb0-4972-b95f-cdbf51b151a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e63ee3-36a5-4577-a955-a8b681d882c0", "name": "network-vif-plugged", "status": "completed", "tag": "98a0cd33-3461-49cd-b20d-682e82acabc0"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:21:20.873447 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=2 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:20.877029 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=6 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:20.889883 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-52d59eea-2c8c-45a0-9ca8-5f6a236da2d3 req-d8e09105-8eb0-4972-b95f-cdbf51b151a9 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:20.890603 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-52d59eea-2c8c-45a0-9ca8-5f6a236da2d3 req-d8e09105-8eb0-4972-b95f-cdbf51b151a9 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:20.916286 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-52d59eea-2c8c-45a0-9ca8-5f6a236da2d3 req-d8e09105-8eb0-4972-b95f-cdbf51b151a9 service nova] Creating event network-vif-plugged:98a0cd33-3461-49cd-b20d-682e82acabc0 for instance a2e63ee3-36a5-4577-a955-a8b681d882c0 on hv-cinder-81914 Jun 16 21:21:20.937511 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-52d59eea-2c8c-45a0-9ca8-5f6a236da2d3 req-d8e09105-8eb0-4972-b95f-cdbf51b151a9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082171 Jun 16 21:21:20.939097 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 576/1175] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:21:21.743036 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-36406644-8547-4dd3-a1b0-0b6e689638a7 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:21.743723 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-36406644-8547-4dd3-a1b0-0b6e689638a7 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:21.745986 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:21.752257 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-36406644-8547-4dd3-a1b0-0b6e689638a7 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:21.752693 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-36406644-8547-4dd3-a1b0-0b6e689638a7 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:21.753462 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-36406644-8547-4dd3-a1b0-0b6e689638a7 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:21.753901 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-36406644-8547-4dd3-a1b0-0b6e689638a7 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:21.895299 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-36406644-8547-4dd3-a1b0-0b6e689638a7 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:21.903576 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-36406644-8547-4dd3-a1b0-0b6e689638a7 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0" status: 200 len: 1314 microversion: 2.1 time: 0.165140 Jun 16 21:21:21.904215 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 600/1176] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:21 2022] GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:22.922040 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d997695c-45d9-452a-8767-0a46503a0c2d tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:22.922757 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d997695c-45d9-452a-8767-0a46503a0c2d tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:22.929368 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d997695c-45d9-452a-8767-0a46503a0c2d tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:22.929813 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d997695c-45d9-452a-8767-0a46503a0c2d tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:22.930642 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d997695c-45d9-452a-8767-0a46503a0c2d tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:22.931077 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d997695c-45d9-452a-8767-0a46503a0c2d tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:23.075968 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d997695c-45d9-452a-8767-0a46503a0c2d tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:23.083977 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d997695c-45d9-452a-8767-0a46503a0c2d tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0" status: 200 len: 1498 microversion: 2.1 time: 0.166820 Jun 16 21:21:23.084564 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 577/1177] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:22 2022] GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0 => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:23.575877 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-313c972a-7092-4ce0-82e7-c885e47ff91f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:23.576463 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-313c972a-7092-4ce0-82e7-c885e47ff91f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:23.583687 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-313c972a-7092-4ce0-82e7-c885e47ff91f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:23.584195 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-313c972a-7092-4ce0-82e7-c885e47ff91f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:23.584983 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-313c972a-7092-4ce0-82e7-c885e47ff91f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:23.585446 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-313c972a-7092-4ce0-82e7-c885e47ff91f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:23.611216 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-313c972a-7092-4ce0-82e7-c885e47ff91f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] Going to try to terminate instance {{(pid=117737) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:21:23.706112 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-313c972a-7092-4ce0-82e7-c885e47ff91f tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0" status: 204 len: 0 microversion: 2.1 time: 0.133777 Jun 16 21:21:23.707217 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 601/1178] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:21:23 2022] DELETE /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:21:23.716224 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5506b40c-b824-4b55-965d-ed69f6b84b90 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:23.716847 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5506b40c-b824-4b55-965d-ed69f6b84b90 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:23.724886 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5506b40c-b824-4b55-965d-ed69f6b84b90 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:23.725341 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5506b40c-b824-4b55-965d-ed69f6b84b90 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:23.726198 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5506b40c-b824-4b55-965d-ed69f6b84b90 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:23.726553 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5506b40c-b824-4b55-965d-ed69f6b84b90 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:24.149936 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5506b40c-b824-4b55-965d-ed69f6b84b90 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:24.158114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5506b40c-b824-4b55-965d-ed69f6b84b90 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0" status: 200 len: 1504 microversion: 2.1 time: 0.445676 Jun 16 21:21:24.158701 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 578/1179] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:23 2022] GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0 => generated 1504 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:25.178598 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d40ab0f5-2d20-4f40-8b9d-40e0e3f71271 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:25.179421 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d40ab0f5-2d20-4f40-8b9d-40e0e3f71271 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:25.186567 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d40ab0f5-2d20-4f40-8b9d-40e0e3f71271 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:25.187034 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d40ab0f5-2d20-4f40-8b9d-40e0e3f71271 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:25.187811 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d40ab0f5-2d20-4f40-8b9d-40e0e3f71271 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:25.188269 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d40ab0f5-2d20-4f40-8b9d-40e0e3f71271 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:25.401465 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d40ab0f5-2d20-4f40-8b9d-40e0e3f71271 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '105646575b4748a88700db4117174c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404175dcaa0144fab98ad34e4834de35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:21:25.411785 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d40ab0f5-2d20-4f40-8b9d-40e0e3f71271 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0" status: 200 len: 1504 microversion: 2.1 time: 0.238039 Jun 16 21:21:25.413417 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 602/1180] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:25 2022] GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0 => generated 1504 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:21:25.850936 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-65c8e218-1b80-4c22-b09e-8ca7262bc2b7 req-6afba40f-54b8-460e-ad73-fa4c28017a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e63ee3-36a5-4577-a955-a8b681d882c0", "name": "network-vif-deleted", "tag": "98a0cd33-3461-49cd-b20d-682e82acabc0"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:21:25.860102 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-65c8e218-1b80-4c22-b09e-8ca7262bc2b7 req-6afba40f-54b8-460e-ad73-fa4c28017a92 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:25.860556 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-65c8e218-1b80-4c22-b09e-8ca7262bc2b7 req-6afba40f-54b8-460e-ad73-fa4c28017a92 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:25.874254 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-65c8e218-1b80-4c22-b09e-8ca7262bc2b7 req-6afba40f-54b8-460e-ad73-fa4c28017a92 service nova] Creating event network-vif-deleted:98a0cd33-3461-49cd-b20d-682e82acabc0 for instance a2e63ee3-36a5-4577-a955-a8b681d882c0 on hv-cinder-81914 Jun 16 21:21:25.879616 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-65c8e218-1b80-4c22-b09e-8ca7262bc2b7 req-6afba40f-54b8-460e-ad73-fa4c28017a92 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032965 Jun 16 21:21:25.880691 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 579/1181] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:21:26.429251 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5f8d51c0-802c-4f96-80df-c3dd6aff35d9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:21:26.430390 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5f8d51c0-802c-4f96-80df-c3dd6aff35d9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] [instance: a2e63ee3-36a5-4577-a955-a8b681d882c0] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:21:26.437480 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5f8d51c0-802c-4f96-80df-c3dd6aff35d9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:26.438025 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5f8d51c0-802c-4f96-80df-c3dd6aff35d9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:26.438809 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5f8d51c0-802c-4f96-80df-c3dd6aff35d9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:21:26.439243 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5f8d51c0-802c-4f96-80df-c3dd6aff35d9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:21:26.453220 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-5f8d51c0-802c-4f96-80df-c3dd6aff35d9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] HTTP exception thrown: Instance a2e63ee3-36a5-4577-a955-a8b681d882c0 could not be found. Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5f8d51c0-802c-4f96-80df-c3dd6aff35d9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Request method failure captured: Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0 HTTP/1.1 Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq56oGT3bW0dOdyrTiEcQwHFw8l2xxsIWEX1JcrGTz4glUYCfqZ6C1tq7RFibpysJrdEWnHcAizYjRka7K--bfyjx8bPVqyqDlM9hPdvdAQnj4ag9CnGWR2QLp5FvHClUHyZYKUpCkhGb7QXmvu5MBCPqH6lICxfELZBEOWdYSybApCU Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: 404175dcaa0144fab98ad34e4834de35 Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-VolumesActionsTest-1533059177 Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:21:26.454858 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:21:26.456499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/404175dcaa0144fab98ad34e4834de35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_404175dcaa0144fab98ad34e4834de35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/404175dcaa0144fab98ad34e4834de35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/404175dcaa0144fab98ad34e4834de35"}]}] Jun 16 21:21:26.456499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-VolumesActionsTest-1533059177 Jun 16 21:21:26.456499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: 404175dcaa0144fab98ad34e4834de35 Jun 16 21:21:26.456499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-VolumesActionsTest-1533059177 Jun 16 21:21:26.456499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-VolumesActionsTest-1533059177-project Jun 16 21:21:26.456499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:21:26.456499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:21:26.456499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 105646575b4748a88700db4117174c0c Jun 16 21:21:26.456499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-VolumesActionsTest-1533059177-project Jun 16 21:21:26.456499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:21:26.456499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance a2e63ee3-36a5-4577-a955-a8b681d882c0 could not be found. Jun 16 21:21:26.456499 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': 'a2e63ee3-36a5-4577-a955-a8b681d882c0'} Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e63ee3-36a5-4577-a955-a8b681d882c0 could not be found. Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:21:26.457523 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e63ee3-36a5-4577-a955-a8b681d882c0 could not be found. Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e63ee3-36a5-4577-a955-a8b681d882c0 could not be found. Jun 16 21:21:26.459286 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:21:26.461220 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5f8d51c0-802c-4f96-80df-c3dd6aff35d9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] Returning 404 to user: Instance a2e63ee3-36a5-4577-a955-a8b681d882c0 could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:21:26.461220 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5f8d51c0-802c-4f96-80df-c3dd6aff35d9 tempest-VolumesActionsTest-1533059177 tempest-VolumesActionsTest-1533059177-project] 10.222.0.43 "GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0" status: 404 len: 111 microversion: 2.1 time: 0.031054 Jun 16 21:21:26.461220 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 603/1182] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:21:26 2022] GET /compute/v2.1/servers/a2e63ee3-36a5-4577-a955-a8b681d882c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:22:03.757137 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-7d7deee6-a0d3-4acc-b239-ed5a8491b1a0 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1598086799", "imageRef": "72f37921-fc7a-4add-8e01-7c8b5ab1652f", "flavorRef": "452"}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:22:03.771351 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:03.772379 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=38 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:03.843048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.network.neutron [None req-7d7deee6-a0d3-4acc-b239-ed5a8491b1a0 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] validate_networks() for None {{(pid=117738) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:22:04.165125 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-7d7deee6-a0d3-4acc-b239-ed5a8491b1a0 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Flavor limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:22:04.165548 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-7d7deee6-a0d3-4acc-b239-ed5a8491b1a0 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Image limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:22:04.166120 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-7d7deee6-a0d3-4acc-b239-ed5a8491b1a0 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Flavor pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:22:04.166524 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-7d7deee6-a0d3-4acc-b239-ed5a8491b1a0 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Image pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:22:04.167583 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-7d7deee6-a0d3-4acc-b239-ed5a8491b1a0 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:22:04.179522 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7d7deee6-a0d3-4acc-b239-ed5a8491b1a0 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:04.180063 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7d7deee6-a0d3-4acc-b239-ed5a8491b1a0 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:04.181078 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7d7deee6-a0d3-4acc-b239-ed5a8491b1a0 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:04.181515 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-7d7deee6-a0d3-4acc-b239-ed5a8491b1a0 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:04.201025 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-7d7deee6-a0d3-4acc-b239-ed5a8491b1a0 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Getting quotas for project 7f9f61ec956d45e88b7e5f16e9132a56. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:22:04.206686 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-7d7deee6-a0d3-4acc-b239-ed5a8491b1a0 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Getting quotas for user 9683d5b707014851a89959b5640fcac7 and project 7f9f61ec956d45e88b7e5f16e9132a56. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:22:04.223935 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7d7deee6-a0d3-4acc-b239-ed5a8491b1a0 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Going to run 1 instances... {{(pid=117738) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:22:04.226685 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-7d7deee6-a0d3-4acc-b239-ed5a8491b1a0 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72f37921-fc7a-4add-8e01-7c8b5ab1652f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:22:04.280416 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-7d7deee6-a0d3-4acc-b239-ed5a8491b1a0 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527679 Jun 16 21:22:04.282013 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 580/1183] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:22:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:22:04.292440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-ba81bd4a-291a-44a4-8dc6-03d57c576cda tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:04.293771 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-ba81bd4a-291a-44a4-8dc6-03d57c576cda tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:04.309106 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:04.310899 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:04.386340 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-ba81bd4a-291a-44a4-8dc6-03d57c576cda tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683d5b707014851a89959b5640fcac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f61ec956d45e88b7e5f16e9132a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:22:04.393307 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-ba81bd4a-291a-44a4-8dc6-03d57c576cda tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 200 len: 1215 microversion: 2.1 time: 0.105258 Jun 16 21:22:04.406979 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 604/1184] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:22:04 2022] GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:22:05.411661 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-48889ed1-74aa-48a9-8c46-8ccbc2f0c909 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:05.412494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-48889ed1-74aa-48a9-8c46-8ccbc2f0c909 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:05.420770 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-48889ed1-74aa-48a9-8c46-8ccbc2f0c909 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:05.421260 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-48889ed1-74aa-48a9-8c46-8ccbc2f0c909 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:05.423250 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-48889ed1-74aa-48a9-8c46-8ccbc2f0c909 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:05.423926 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-48889ed1-74aa-48a9-8c46-8ccbc2f0c909 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:05.509656 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-48889ed1-74aa-48a9-8c46-8ccbc2f0c909 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683d5b707014851a89959b5640fcac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f61ec956d45e88b7e5f16e9132a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:22:05.520194 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-48889ed1-74aa-48a9-8c46-8ccbc2f0c909 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 200 len: 1267 microversion: 2.1 time: 0.113477 Jun 16 21:22:05.520787 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 581/1185] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:22:05 2022] GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 1267 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:22:06.538076 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-94d36775-99a2-4188-be19-a0aec7f34603 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:06.539765 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-94d36775-99a2-4188-be19-a0aec7f34603 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:06.558635 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-94d36775-99a2-4188-be19-a0aec7f34603 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:06.559366 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-94d36775-99a2-4188-be19-a0aec7f34603 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:06.561789 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-94d36775-99a2-4188-be19-a0aec7f34603 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:06.563114 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-94d36775-99a2-4188-be19-a0aec7f34603 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:06.890614 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-94d36775-99a2-4188-be19-a0aec7f34603 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683d5b707014851a89959b5640fcac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f61ec956d45e88b7e5f16e9132a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:22:06.903163 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-94d36775-99a2-4188-be19-a0aec7f34603 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 200 len: 1315 microversion: 2.1 time: 0.368260 Jun 16 21:22:06.903743 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 605/1186] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:22:06 2022] GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:22:07.368687 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-0afb5097-b843-412e-b011-7ccdedad9359 req-1e41295b-9c12-4bfc-bc6a-22c13361bf23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6cf54d-6975-4eb4-803e-d52e96eaffb8", "tag": "ae900fb5-3bc9-4b6b-87d5-415296ab7936"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:22:07.381743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-0afb5097-b843-412e-b011-7ccdedad9359 req-1e41295b-9c12-4bfc-bc6a-22c13361bf23 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:07.382233 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-0afb5097-b843-412e-b011-7ccdedad9359 req-1e41295b-9c12-4bfc-bc6a-22c13361bf23 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:07.393981 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-0afb5097-b843-412e-b011-7ccdedad9359 req-1e41295b-9c12-4bfc-bc6a-22c13361bf23 service nova] Creating event network-changed:ae900fb5-3bc9-4b6b-87d5-415296ab7936 for instance 0e6cf54d-6975-4eb4-803e-d52e96eaffb8 on hv-cinder-81914 Jun 16 21:22:07.399664 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-0afb5097-b843-412e-b011-7ccdedad9359 req-1e41295b-9c12-4bfc-bc6a-22c13361bf23 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034651 Jun 16 21:22:07.400285 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 582/1187] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:22:07.920389 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b054574d-e4b2-4b19-9298-be7423ae56bf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:07.920932 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b054574d-e4b2-4b19-9298-be7423ae56bf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:07.927526 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b054574d-e4b2-4b19-9298-be7423ae56bf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:07.927973 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b054574d-e4b2-4b19-9298-be7423ae56bf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:07.928772 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b054574d-e4b2-4b19-9298-be7423ae56bf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:07.929204 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-b054574d-e4b2-4b19-9298-be7423ae56bf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:08.064406 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b054574d-e4b2-4b19-9298-be7423ae56bf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683d5b707014851a89959b5640fcac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f61ec956d45e88b7e5f16e9132a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:22:08.071676 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b054574d-e4b2-4b19-9298-be7423ae56bf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 200 len: 1315 microversion: 2.1 time: 0.155278 Jun 16 21:22:08.072241 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 606/1188] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:22:07 2022] GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:22:09.090199 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8f11e2a6-62ab-4539-b7d0-d1ae77684d5c tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:09.090898 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8f11e2a6-62ab-4539-b7d0-d1ae77684d5c tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:09.098274 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8f11e2a6-62ab-4539-b7d0-d1ae77684d5c tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:09.098717 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8f11e2a6-62ab-4539-b7d0-d1ae77684d5c tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:09.099476 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8f11e2a6-62ab-4539-b7d0-d1ae77684d5c tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:09.099906 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8f11e2a6-62ab-4539-b7d0-d1ae77684d5c tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:09.229871 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8f11e2a6-62ab-4539-b7d0-d1ae77684d5c tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683d5b707014851a89959b5640fcac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f61ec956d45e88b7e5f16e9132a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:22:09.237512 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8f11e2a6-62ab-4539-b7d0-d1ae77684d5c tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 200 len: 1315 microversion: 2.1 time: 0.151919 Jun 16 21:22:09.238088 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 583/1189] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:22:09 2022] GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:22:10.256551 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-8c2e5c60-e637-42c3-8fe8-3df21307948f tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:10.258030 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-8c2e5c60-e637-42c3-8fe8-3df21307948f tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:10.265229 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8c2e5c60-e637-42c3-8fe8-3df21307948f tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:10.266522 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8c2e5c60-e637-42c3-8fe8-3df21307948f tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:10.267750 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8c2e5c60-e637-42c3-8fe8-3df21307948f tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:10.268342 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-8c2e5c60-e637-42c3-8fe8-3df21307948f tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:10.515762 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-8c2e5c60-e637-42c3-8fe8-3df21307948f tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683d5b707014851a89959b5640fcac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f61ec956d45e88b7e5f16e9132a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:22:10.524335 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-8c2e5c60-e637-42c3-8fe8-3df21307948f tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 200 len: 1315 microversion: 2.1 time: 0.271724 Jun 16 21:22:10.524981 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 607/1190] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:22:10 2022] GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:22:11.541791 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-3c142a3e-9fe6-4ebc-990e-f47b5e806594 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:11.542405 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-3c142a3e-9fe6-4ebc-990e-f47b5e806594 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:11.549438 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3c142a3e-9fe6-4ebc-990e-f47b5e806594 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:11.549638 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3c142a3e-9fe6-4ebc-990e-f47b5e806594 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:11.550404 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3c142a3e-9fe6-4ebc-990e-f47b5e806594 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:11.550839 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-3c142a3e-9fe6-4ebc-990e-f47b5e806594 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:11.681245 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-3c142a3e-9fe6-4ebc-990e-f47b5e806594 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683d5b707014851a89959b5640fcac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f61ec956d45e88b7e5f16e9132a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:22:11.689730 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-3c142a3e-9fe6-4ebc-990e-f47b5e806594 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 200 len: 1315 microversion: 2.1 time: 0.151809 Jun 16 21:22:11.690287 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 584/1191] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:22:11 2022] GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:22:12.709191 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-bc263d0a-baf2-4fae-9c75-8e833a8d0bd5 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:12.709806 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-bc263d0a-baf2-4fae-9c75-8e833a8d0bd5 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:12.716199 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bc263d0a-baf2-4fae-9c75-8e833a8d0bd5 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:12.716840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bc263d0a-baf2-4fae-9c75-8e833a8d0bd5 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:12.717593 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bc263d0a-baf2-4fae-9c75-8e833a8d0bd5 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:12.718019 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bc263d0a-baf2-4fae-9c75-8e833a8d0bd5 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:12.865356 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bc263d0a-baf2-4fae-9c75-8e833a8d0bd5 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683d5b707014851a89959b5640fcac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f61ec956d45e88b7e5f16e9132a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:22:12.876032 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-bc263d0a-baf2-4fae-9c75-8e833a8d0bd5 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 200 len: 1315 microversion: 2.1 time: 0.171589 Jun 16 21:22:12.876996 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 608/1192] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:22:12 2022] GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:22:13.892898 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-f8dacd20-2380-4974-a7fa-911b498ac607 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:13.893428 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-f8dacd20-2380-4974-a7fa-911b498ac607 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:13.899889 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f8dacd20-2380-4974-a7fa-911b498ac607 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:13.900382 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f8dacd20-2380-4974-a7fa-911b498ac607 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:13.901143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f8dacd20-2380-4974-a7fa-911b498ac607 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:13.901576 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-f8dacd20-2380-4974-a7fa-911b498ac607 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:14.037719 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-f8dacd20-2380-4974-a7fa-911b498ac607 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683d5b707014851a89959b5640fcac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f61ec956d45e88b7e5f16e9132a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:22:14.045097 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-f8dacd20-2380-4974-a7fa-911b498ac607 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 200 len: 1315 microversion: 2.1 time: 0.156137 Jun 16 21:22:14.045658 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 585/1193] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:22:13 2022] GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:22:15.064201 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-d755d6b6-94dd-4481-8b38-9003a8d88aea tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:15.064804 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-d755d6b6-94dd-4481-8b38-9003a8d88aea tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:15.071136 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:15.073303 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d755d6b6-94dd-4481-8b38-9003a8d88aea tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:15.074866 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d755d6b6-94dd-4481-8b38-9003a8d88aea tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:15.075664 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d755d6b6-94dd-4481-8b38-9003a8d88aea tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:15.077028 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-d755d6b6-94dd-4481-8b38-9003a8d88aea tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:15.222265 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-95f0d75e-8314-4c6f-b7f2-3298ead47d54 req-34875b7e-e624-4ea8-b227-772f04562cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6cf54d-6975-4eb4-803e-d52e96eaffb8", "name": "network-vif-plugged", "status": "completed", "tag": "ae900fb5-3bc9-4b6b-87d5-415296ab7936"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:22:15.232273 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=2 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:15.233005 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=6 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:15.248652 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-d755d6b6-94dd-4481-8b38-9003a8d88aea tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683d5b707014851a89959b5640fcac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f61ec956d45e88b7e5f16e9132a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:22:15.254968 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-95f0d75e-8314-4c6f-b7f2-3298ead47d54 req-34875b7e-e624-4ea8-b227-772f04562cdb service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:15.255917 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-95f0d75e-8314-4c6f-b7f2-3298ead47d54 req-34875b7e-e624-4ea8-b227-772f04562cdb service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:15.258015 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-d755d6b6-94dd-4481-8b38-9003a8d88aea tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 200 len: 1315 microversion: 2.1 time: 0.199330 Jun 16 21:22:15.258593 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 609/1194] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:22:15 2022] GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:22:15.276311 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-95f0d75e-8314-4c6f-b7f2-3298ead47d54 req-34875b7e-e624-4ea8-b227-772f04562cdb service nova] Creating event network-vif-plugged:ae900fb5-3bc9-4b6b-87d5-415296ab7936 for instance 0e6cf54d-6975-4eb4-803e-d52e96eaffb8 on hv-cinder-81914 Jun 16 21:22:15.282660 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-95f0d75e-8314-4c6f-b7f2-3298ead47d54 req-34875b7e-e624-4ea8-b227-772f04562cdb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067142 Jun 16 21:22:15.283411 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 586/1195] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:22:16.274892 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-4203a05f-639f-45ee-bc47-fb82087cae35 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:16.275517 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-4203a05f-639f-45ee-bc47-fb82087cae35 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:16.282691 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4203a05f-639f-45ee-bc47-fb82087cae35 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:16.283136 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4203a05f-639f-45ee-bc47-fb82087cae35 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:16.283932 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4203a05f-639f-45ee-bc47-fb82087cae35 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:16.284392 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-4203a05f-639f-45ee-bc47-fb82087cae35 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:16.418394 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-4203a05f-639f-45ee-bc47-fb82087cae35 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683d5b707014851a89959b5640fcac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f61ec956d45e88b7e5f16e9132a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:22:16.426817 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-4203a05f-639f-45ee-bc47-fb82087cae35 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 200 len: 1315 microversion: 2.1 time: 0.155752 Jun 16 21:22:16.427394 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 610/1196] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:22:16 2022] GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:22:17.444997 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-33cf69d9-429d-4155-8d56-90bd6fea60c6 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:17.445726 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-33cf69d9-429d-4155-8d56-90bd6fea60c6 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:17.453902 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-33cf69d9-429d-4155-8d56-90bd6fea60c6 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:17.454731 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-33cf69d9-429d-4155-8d56-90bd6fea60c6 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:17.455536 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-33cf69d9-429d-4155-8d56-90bd6fea60c6 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:17.455979 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-33cf69d9-429d-4155-8d56-90bd6fea60c6 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:17.585048 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-33cf69d9-429d-4155-8d56-90bd6fea60c6 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683d5b707014851a89959b5640fcac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f61ec956d45e88b7e5f16e9132a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:22:17.592531 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-33cf69d9-429d-4155-8d56-90bd6fea60c6 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 200 len: 1465 microversion: 2.1 time: 0.152388 Jun 16 21:22:17.593102 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 587/1197] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:22:17 2022] GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 1465 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:22:17.632124 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-a1553231-4fea-4140-8c5c-0a3d4f6bafee tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:17.632659 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a1553231-4fea-4140-8c5c-0a3d4f6bafee tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:17.639109 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a1553231-4fea-4140-8c5c-0a3d4f6bafee tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:17.639557 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a1553231-4fea-4140-8c5c-0a3d4f6bafee tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:17.640406 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a1553231-4fea-4140-8c5c-0a3d4f6bafee tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:17.640838 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-a1553231-4fea-4140-8c5c-0a3d4f6bafee tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:17.665714 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-a1553231-4fea-4140-8c5c-0a3d4f6bafee tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Going to try to terminate instance {{(pid=117737) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:22:17.743529 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-a1553231-4fea-4140-8c5c-0a3d4f6bafee tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 204 len: 0 microversion: 2.1 time: 0.114897 Jun 16 21:22:17.744121 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 611/1198] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:22:17 2022] DELETE /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:22:17.752717 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d6c3bbae-8ce7-4872-b074-efc9734f111d tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:17.753365 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d6c3bbae-8ce7-4872-b074-efc9734f111d tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:17.759326 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d6c3bbae-8ce7-4872-b074-efc9734f111d tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:17.759768 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d6c3bbae-8ce7-4872-b074-efc9734f111d tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:17.760630 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d6c3bbae-8ce7-4872-b074-efc9734f111d tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:17.761069 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d6c3bbae-8ce7-4872-b074-efc9734f111d tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:17.889555 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-d6c3bbae-8ce7-4872-b074-efc9734f111d tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683d5b707014851a89959b5640fcac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f61ec956d45e88b7e5f16e9132a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:22:17.897411 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d6c3bbae-8ce7-4872-b074-efc9734f111d tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 200 len: 1471 microversion: 2.1 time: 0.148581 Jun 16 21:22:17.897965 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 588/1199] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:22:17 2022] GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:22:18.916337 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-24ff7701-8c09-4643-b088-39353033ea92 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:18.916988 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-24ff7701-8c09-4643-b088-39353033ea92 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:18.923866 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-24ff7701-8c09-4643-b088-39353033ea92 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:18.924335 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-24ff7701-8c09-4643-b088-39353033ea92 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:18.925093 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-24ff7701-8c09-4643-b088-39353033ea92 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:18.925522 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-24ff7701-8c09-4643-b088-39353033ea92 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:19.059456 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-24ff7701-8c09-4643-b088-39353033ea92 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683d5b707014851a89959b5640fcac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f61ec956d45e88b7e5f16e9132a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:22:19.068982 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-24ff7701-8c09-4643-b088-39353033ea92 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 200 len: 1471 microversion: 2.1 time: 0.156915 Jun 16 21:22:19.069557 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 612/1200] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:22:18 2022] GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:22:19.634154 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-254c4206-fdc2-44f2-9ba5-5e46971279f4 req-e68b3811-546e-4aa8-83cd-9605643661a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6cf54d-6975-4eb4-803e-d52e96eaffb8", "name": "network-vif-deleted", "tag": "ae900fb5-3bc9-4b6b-87d5-415296ab7936"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:22:19.644555 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-254c4206-fdc2-44f2-9ba5-5e46971279f4 req-e68b3811-546e-4aa8-83cd-9605643661a2 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:19.645094 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-254c4206-fdc2-44f2-9ba5-5e46971279f4 req-e68b3811-546e-4aa8-83cd-9605643661a2 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:19.661975 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-254c4206-fdc2-44f2-9ba5-5e46971279f4 req-e68b3811-546e-4aa8-83cd-9605643661a2 service nova] Creating event network-vif-deleted:ae900fb5-3bc9-4b6b-87d5-415296ab7936 for instance 0e6cf54d-6975-4eb4-803e-d52e96eaffb8 on hv-cinder-81914 Jun 16 21:22:19.666943 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-254c4206-fdc2-44f2-9ba5-5e46971279f4 req-e68b3811-546e-4aa8-83cd-9605643661a2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036478 Jun 16 21:22:19.667545 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 589/1201] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:22:20.086832 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-3ab15c09-780e-47c3-8534-6dc199c64ddf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:20.087451 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-3ab15c09-780e-47c3-8534-6dc199c64ddf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:20.094762 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3ab15c09-780e-47c3-8534-6dc199c64ddf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:20.095211 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3ab15c09-780e-47c3-8534-6dc199c64ddf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:20.095982 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3ab15c09-780e-47c3-8534-6dc199c64ddf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:20.096514 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3ab15c09-780e-47c3-8534-6dc199c64ddf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:20.129123 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3ab15c09-780e-47c3-8534-6dc199c64ddf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:20.129580 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-3ab15c09-780e-47c3-8534-6dc199c64ddf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:20.130007 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.objects.instance [None req-3ab15c09-780e-47c3-8534-6dc199c64ddf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lazy-loading 'fault' on Instance uuid 0e6cf54d-6975-4eb4-803e-d52e96eaffb8 {{(pid=117737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 21:22:20.177143 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-3ab15c09-780e-47c3-8534-6dc199c64ddf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683d5b707014851a89959b5640fcac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f61ec956d45e88b7e5f16e9132a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:22:20.183945 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-3ab15c09-780e-47c3-8534-6dc199c64ddf tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 200 len: 1305 microversion: 2.1 time: 0.100994 Jun 16 21:22:20.184528 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 613/1202] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:22:20 2022] GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:22:21.202136 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-25f55347-b7ad-4c03-b911-85361ed215f4 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:22:21.203931 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-25f55347-b7ad-4c03-b911-85361ed215f4 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] [instance: 0e6cf54d-6975-4eb4-803e-d52e96eaffb8] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:22:21.210671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-25f55347-b7ad-4c03-b911-85361ed215f4 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:21.211482 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-25f55347-b7ad-4c03-b911-85361ed215f4 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:21.212928 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-25f55347-b7ad-4c03-b911-85361ed215f4 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:22:21.213725 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-25f55347-b7ad-4c03-b911-85361ed215f4 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:22:21.227608 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-25f55347-b7ad-4c03-b911-85361ed215f4 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] HTTP exception thrown: Instance 0e6cf54d-6975-4eb4-803e-d52e96eaffb8 could not be found. Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-25f55347-b7ad-4c03-b911-85361ed215f4 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Request method failure captured: Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 HTTP/1.1 Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq576nr4MJ-BnR3x-ermKhTv1rmkjD3Tw47TtXmMPgeHLcRlsUD33MI-rn5aIvomHYInyRd7_zplJtlqXThKAMPOOAs5g0sU9nM3CoZ8lZQ4aV1KjCDAWMsfckOnW8ilxM-4Kx3YKf0rE18Lju5AylG2jr1CzlXuCuxY55wzqswJDur0 Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: 7f9f61ec956d45e88b7e5f16e9132a56 Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-VolumesNegativeTest-1974496687 Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:22:21.229289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:22:21.230785 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7f9f61ec956d45e88b7e5f16e9132a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7f9f61ec956d45e88b7e5f16e9132a56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7f9f61ec956d45e88b7e5f16e9132a56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7f9f61ec956d45e88b7e5f16e9132a56"}]}] Jun 16 21:22:21.230785 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-VolumesNegativeTest-1974496687 Jun 16 21:22:21.230785 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: 7f9f61ec956d45e88b7e5f16e9132a56 Jun 16 21:22:21.230785 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-VolumesNegativeTest-1974496687 Jun 16 21:22:21.230785 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-VolumesNegativeTest-1974496687-project Jun 16 21:22:21.230785 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:22:21.230785 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:22:21.230785 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 9683d5b707014851a89959b5640fcac7 Jun 16 21:22:21.230785 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-VolumesNegativeTest-1974496687-project Jun 16 21:22:21.230785 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:22:21.230785 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 0e6cf54d-6975-4eb4-803e-d52e96eaffb8 could not be found. Jun 16 21:22:21.230785 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '0e6cf54d-6975-4eb4-803e-d52e96eaffb8'} Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6cf54d-6975-4eb4-803e-d52e96eaffb8 could not be found. Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:22:21.231695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6cf54d-6975-4eb4-803e-d52e96eaffb8 could not be found. Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6cf54d-6975-4eb4-803e-d52e96eaffb8 could not be found. Jun 16 21:22:21.233523 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:22:21.235582 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-25f55347-b7ad-4c03-b911-85361ed215f4 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] Returning 404 to user: Instance 0e6cf54d-6975-4eb4-803e-d52e96eaffb8 could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:22:21.235582 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-25f55347-b7ad-4c03-b911-85361ed215f4 tempest-VolumesNegativeTest-1974496687 tempest-VolumesNegativeTest-1974496687-project] 10.222.0.43 "GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8" status: 404 len: 111 microversion: 2.1 time: 0.033337 Jun 16 21:22:21.235582 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 590/1203] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:22:21 2022] GET /compute/v2.1/servers/0e6cf54d-6975-4eb4-803e-d52e96eaffb8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 21:23:12.726071 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 21:23:12.726666 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Thu Jun 16 21:23:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 21:23:22.944947 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 21:23:22.945569 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Thu Jun 16 21:23:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 21:23:41.350219 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:23:41.350977 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:23:41.355163 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-5a7f942f-1f47-40d8-8741-a7acf757569c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:41.355654 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5a7f942f-1f47-40d8-8741-a7acf757569c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:41.364361 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5a7f942f-1f47-40d8-8741-a7acf757569c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:41.365133 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5a7f942f-1f47-40d8-8741-a7acf757569c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:41.366444 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5a7f942f-1f47-40d8-8741-a7acf757569c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:41.366884 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-5a7f942f-1f47-40d8-8741-a7acf757569c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:41.397303 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-5a7f942f-1f47-40d8-8741-a7acf757569c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Going to try to terminate instance {{(pid=117737) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:23:41.470584 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-5a7f942f-1f47-40d8-8741-a7acf757569c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "DELETE /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 204 len: 0 microversion: 2.1 time: 0.121960 Jun 16 21:23:41.471344 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 614/1204] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:23:41 2022] DELETE /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:23:41.478888 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:23:41.479693 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=46 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:23:41.483473 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-0a84891d-9324-4604-bdb5-63a46c131c8b tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:41.484083 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-0a84891d-9324-4604-bdb5-63a46c131c8b tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:41.492032 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0a84891d-9324-4604-bdb5-63a46c131c8b tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:41.492502 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0a84891d-9324-4604-bdb5-63a46c131c8b tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:41.493266 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0a84891d-9324-4604-bdb5-63a46c131c8b tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:41.493695 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-0a84891d-9324-4604-bdb5-63a46c131c8b tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:41.782216 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-0a84891d-9324-4604-bdb5-63a46c131c8b tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:23:41.789797 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-0a84891d-9324-4604-bdb5-63a46c131c8b tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1576 microversion: 2.1 time: 0.312884 Jun 16 21:23:41.790352 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 591/1205] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:23:41 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1576 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:23:42.809701 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-e9d6a0cd-5ee7-41b3-afb1-21300b2f61a4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:42.810440 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-e9d6a0cd-5ee7-41b3-afb1-21300b2f61a4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:42.817235 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e9d6a0cd-5ee7-41b3-afb1-21300b2f61a4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:42.817675 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e9d6a0cd-5ee7-41b3-afb1-21300b2f61a4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:42.818443 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e9d6a0cd-5ee7-41b3-afb1-21300b2f61a4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:42.818874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-e9d6a0cd-5ee7-41b3-afb1-21300b2f61a4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:43.006794 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-e9d6a0cd-5ee7-41b3-afb1-21300b2f61a4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:23:43.014262 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-e9d6a0cd-5ee7-41b3-afb1-21300b2f61a4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1576 microversion: 2.1 time: 0.209978 Jun 16 21:23:43.014827 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 615/1206] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:23:42 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:23:44.030859 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c563435e-15c0-464b-aa43-011390386d47 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:44.031479 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c563435e-15c0-464b-aa43-011390386d47 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:44.039971 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c563435e-15c0-464b-aa43-011390386d47 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:44.040454 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c563435e-15c0-464b-aa43-011390386d47 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:44.041244 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c563435e-15c0-464b-aa43-011390386d47 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:44.041681 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c563435e-15c0-464b-aa43-011390386d47 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:44.108146 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c563435e-15c0-464b-aa43-011390386d47 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:23:44.118308 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c563435e-15c0-464b-aa43-011390386d47 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 200 len: 1509 microversion: 2.1 time: 0.091223 Jun 16 21:23:44.125982 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 592/1207] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:23:44 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 1509 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:23:44.166943 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-9e19dfd1-01da-4304-863f-f4d6b50d03d1 req-7c7e13a6-feea-4008-9a2a-66fde3117982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334a1b5b-c324-4952-9875-f93b251a544c", "name": "network-vif-deleted", "tag": "a184de69-92f7-4829-83d3-e946b229e004"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:23:44.178153 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-9e19dfd1-01da-4304-863f-f4d6b50d03d1 req-7c7e13a6-feea-4008-9a2a-66fde3117982 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:44.178908 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-9e19dfd1-01da-4304-863f-f4d6b50d03d1 req-7c7e13a6-feea-4008-9a2a-66fde3117982 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:44.193085 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-9e19dfd1-01da-4304-863f-f4d6b50d03d1 req-7c7e13a6-feea-4008-9a2a-66fde3117982 service nova] Creating event network-vif-deleted:a184de69-92f7-4829-83d3-e946b229e004 for instance 334a1b5b-c324-4952-9875-f93b251a544c on hv-cinder-81914 Jun 16 21:23:44.198806 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-9e19dfd1-01da-4304-863f-f4d6b50d03d1 req-7c7e13a6-feea-4008-9a2a-66fde3117982 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129545 Jun 16 21:23:44.199696 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 616/1208] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:23:45.134855 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-62450ebd-1621-4dbf-a1e2-4e1b37d128d6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:45.135471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-62450ebd-1621-4dbf-a1e2-4e1b37d128d6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:45.141961 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-62450ebd-1621-4dbf-a1e2-4e1b37d128d6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:45.142412 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-62450ebd-1621-4dbf-a1e2-4e1b37d128d6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:45.143174 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-62450ebd-1621-4dbf-a1e2-4e1b37d128d6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:45.143610 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-62450ebd-1621-4dbf-a1e2-4e1b37d128d6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:45.157866 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-62450ebd-1621-4dbf-a1e2-4e1b37d128d6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] HTTP exception thrown: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-62450ebd-1621-4dbf-a1e2-4e1b37d128d6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Request method failure captured: Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c HTTP/1.1 Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq56Llv3ryZkyCbRk0t5zG4G9MvYA1WMRX0dufjj8QeDkpg8uTgcid7rjKZB8rZYvw6mv5z9RmztTzmv9RoRYR6lnDyY3kIHKk8HijLMgYQaDfAyFCpDb0T4dKHNHJVOeKFdH2LcYOYiNyhfk8HsrjXciaSx2jYyyyYDcVBxYIgBa6ZU Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: b568a213302f46fda9ab9467d36996c5 Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-TestVolumeBootPattern-691594804 Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:23:45.159374 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:23:45.161471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b568a213302f46fda9ab9467d36996c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b568a213302f46fda9ab9467d36996c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b568a213302f46fda9ab9467d36996c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b568a213302f46fda9ab9467d36996c5"}]}] Jun 16 21:23:45.161471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-TestVolumeBootPattern-691594804 Jun 16 21:23:45.161471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: b568a213302f46fda9ab9467d36996c5 Jun 16 21:23:45.161471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-TestVolumeBootPattern-691594804 Jun 16 21:23:45.161471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-TestVolumeBootPattern-691594804-project Jun 16 21:23:45.161471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:23:45.161471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:23:45.161471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 236f49a4117f488ea8bf5c523fadadc8 Jun 16 21:23:45.161471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-TestVolumeBootPattern-691594804-project Jun 16 21:23:45.161471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:23:45.161471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. Jun 16 21:23:45.161471 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '334a1b5b-c324-4952-9875-f93b251a544c'} Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:23:45.162347 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. Jun 16 21:23:45.163970 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:23:45.165494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-62450ebd-1621-4dbf-a1e2-4e1b37d128d6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Returning 404 to user: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:23:45.165494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-62450ebd-1621-4dbf-a1e2-4e1b37d128d6 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 404 len: 111 microversion: 2.1 time: 0.030375 Jun 16 21:23:45.165494 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 593/1209] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:23:45 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:23:45.254999 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-67bf14be-721a-411a-80d0-a83942c7310e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1371396674", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-304404175", "security_groups": [{"name": "tempest-secgroup-smoke-148137412"}], "block_device_mapping_v2": [{"uuid": "f811a247-2f05-4ceb-9e9b-56ea5db025ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61c8c5ff-f4fd-4e8b-b3f3-0e031fc4324d"}]}} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:23:45.366204 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.network.neutron [None req-67bf14be-721a-411a-80d0-a83942c7310e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] validate_networks() for [('61c8c5ff-f4fd-4e8b-b3f3-0e031fc4324d', None, None, None, None, None)] {{(pid=117737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:23:45.783611 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-67bf14be-721a-411a-80d0-a83942c7310e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Flavor limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:23:45.784037 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-67bf14be-721a-411a-80d0-a83942c7310e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Image limits 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:23:45.785052 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-67bf14be-721a-411a-80d0-a83942c7310e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Flavor pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:23:45.785463 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-67bf14be-721a-411a-80d0-a83942c7310e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Image pref 0:0:0 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:23:45.785874 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.virt.hardware [None req-67bf14be-721a-411a-80d0-a83942c7310e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:23:45.794590 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-67bf14be-721a-411a-80d0-a83942c7310e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:45.795034 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-67bf14be-721a-411a-80d0-a83942c7310e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:45.795830 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-67bf14be-721a-411a-80d0-a83942c7310e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:45.796298 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-67bf14be-721a-411a-80d0-a83942c7310e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:45.812621 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-67bf14be-721a-411a-80d0-a83942c7310e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Getting quotas for project b568a213302f46fda9ab9467d36996c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:23:45.817152 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.quota [None req-67bf14be-721a-411a-80d0-a83942c7310e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Getting quotas for user 236f49a4117f488ea8bf5c523fadadc8 and project b568a213302f46fda9ab9467d36996c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:23:45.873056 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-67bf14be-721a-411a-80d0-a83942c7310e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Going to run 1 instances... {{(pid=117737) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:23:45.875183 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-67bf14be-721a-411a-80d0-a83942c7310e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f811a247-2f05-4ceb-9e9b-56ea5db025ef',volume_size=None,volume_type=None)] {{(pid=117737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:23:46.005559 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-67bf14be-721a-411a-80d0-a83942c7310e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.754831 Jun 16 21:23:46.006191 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 617/1210] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:23:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:23:46.015672 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4acead9c-0d74-4047-94b2-49217e512334 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:46.016292 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4acead9c-0d74-4047-94b2-49217e512334 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:46.068997 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4acead9c-0d74-4047-94b2-49217e512334 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:23:46.075608 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4acead9c-0d74-4047-94b2-49217e512334 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1094 microversion: 2.1 time: 0.063556 Jun 16 21:23:46.076162 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 594/1211] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:23:46 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:23:47.094374 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c4be4c82-1178-4b3d-ba47-a1c86bf0e16e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:47.095159 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c4be4c82-1178-4b3d-ba47-a1c86bf0e16e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:47.102547 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c4be4c82-1178-4b3d-ba47-a1c86bf0e16e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:47.102998 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c4be4c82-1178-4b3d-ba47-a1c86bf0e16e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:47.104027 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c4be4c82-1178-4b3d-ba47-a1c86bf0e16e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:47.104502 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c4be4c82-1178-4b3d-ba47-a1c86bf0e16e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:47.184820 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c4be4c82-1178-4b3d-ba47-a1c86bf0e16e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:23:47.192287 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c4be4c82-1178-4b3d-ba47-a1c86bf0e16e tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1210 microversion: 2.1 time: 0.102933 Jun 16 21:23:47.192844 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 618/1212] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:23:47 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:23:48.209300 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4dca2338-fd96-4164-8ecb-7112a6efe4a8 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:48.209923 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4dca2338-fd96-4164-8ecb-7112a6efe4a8 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:48.219218 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4dca2338-fd96-4164-8ecb-7112a6efe4a8 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:48.219669 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4dca2338-fd96-4164-8ecb-7112a6efe4a8 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:48.220503 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4dca2338-fd96-4164-8ecb-7112a6efe4a8 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:48.220941 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4dca2338-fd96-4164-8ecb-7112a6efe4a8 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:48.366124 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4dca2338-fd96-4164-8ecb-7112a6efe4a8 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:23:48.374017 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4dca2338-fd96-4164-8ecb-7112a6efe4a8 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1265 microversion: 2.1 time: 0.168723 Jun 16 21:23:48.374645 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 595/1213] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:23:48 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:23:48.493940 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-a195f0d9-8bac-435c-bf31-727804371f59 req-0b0e5591-0f06-4e90-ae01-57ccf6508c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b395a467-044b-4985-9c95-e86e58ec9012", "tag": "0a40dae4-ce88-45f2-8618-3e70841b7d83"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:23:48.507182 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-a195f0d9-8bac-435c-bf31-727804371f59 req-0b0e5591-0f06-4e90-ae01-57ccf6508c6c service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:48.508473 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-a195f0d9-8bac-435c-bf31-727804371f59 req-0b0e5591-0f06-4e90-ae01-57ccf6508c6c service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:48.523589 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-a195f0d9-8bac-435c-bf31-727804371f59 req-0b0e5591-0f06-4e90-ae01-57ccf6508c6c service nova] Creating event network-changed:0a40dae4-ce88-45f2-8618-3e70841b7d83 for instance b395a467-044b-4985-9c95-e86e58ec9012 on hv-cinder-81914 Jun 16 21:23:48.529330 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-a195f0d9-8bac-435c-bf31-727804371f59 req-0b0e5591-0f06-4e90-ae01-57ccf6508c6c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039562 Jun 16 21:23:48.530050 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 619/1214] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:23:49.390992 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-dafb31d3-775f-4f43-99b2-65803702cfa4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:49.391893 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-dafb31d3-775f-4f43-99b2-65803702cfa4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:49.398185 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-dafb31d3-775f-4f43-99b2-65803702cfa4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:49.398635 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-dafb31d3-775f-4f43-99b2-65803702cfa4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:49.399403 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-dafb31d3-775f-4f43-99b2-65803702cfa4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:49.399841 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-dafb31d3-775f-4f43-99b2-65803702cfa4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:49.531118 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-dafb31d3-775f-4f43-99b2-65803702cfa4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:23:49.539709 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-dafb31d3-775f-4f43-99b2-65803702cfa4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1265 microversion: 2.1 time: 0.152636 Jun 16 21:23:49.542596 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 596/1215] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:23:49 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:23:50.557236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9a355639-d925-41f8-a140-3b10071fe408 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:50.557928 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-9a355639-d925-41f8-a140-3b10071fe408 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:50.564021 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9a355639-d925-41f8-a140-3b10071fe408 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:50.564501 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9a355639-d925-41f8-a140-3b10071fe408 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:50.565257 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9a355639-d925-41f8-a140-3b10071fe408 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:50.566697 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9a355639-d925-41f8-a140-3b10071fe408 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:50.701058 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9a355639-d925-41f8-a140-3b10071fe408 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:23:50.709070 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9a355639-d925-41f8-a140-3b10071fe408 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1265 microversion: 2.1 time: 0.156585 Jun 16 21:23:50.709638 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 620/1216] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:23:50 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:23:51.725826 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-8bb1dd6e-5fee-46b6-a364-494f7c1495fd tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:51.726425 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-8bb1dd6e-5fee-46b6-a364-494f7c1495fd tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:51.733023 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8bb1dd6e-5fee-46b6-a364-494f7c1495fd tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:51.733470 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8bb1dd6e-5fee-46b6-a364-494f7c1495fd tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:51.734230 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8bb1dd6e-5fee-46b6-a364-494f7c1495fd tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:51.734664 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-8bb1dd6e-5fee-46b6-a364-494f7c1495fd tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:51.863475 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-8bb1dd6e-5fee-46b6-a364-494f7c1495fd tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:23:51.870898 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-8bb1dd6e-5fee-46b6-a364-494f7c1495fd tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1265 microversion: 2.1 time: 0.149760 Jun 16 21:23:51.871460 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 597/1217] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:23:51 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:23:52.888741 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-f3116b0f-1295-42e0-8bc4-6af57899d3d0 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:52.889294 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-f3116b0f-1295-42e0-8bc4-6af57899d3d0 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:52.896581 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f3116b0f-1295-42e0-8bc4-6af57899d3d0 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:52.897031 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f3116b0f-1295-42e0-8bc4-6af57899d3d0 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:52.897791 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f3116b0f-1295-42e0-8bc4-6af57899d3d0 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:52.898226 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-f3116b0f-1295-42e0-8bc4-6af57899d3d0 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:53.034971 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-f3116b0f-1295-42e0-8bc4-6af57899d3d0 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:23:53.042363 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-f3116b0f-1295-42e0-8bc4-6af57899d3d0 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1265 microversion: 2.1 time: 0.157578 Jun 16 21:23:53.042919 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 621/1218] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:23:52 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:23:54.058707 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6a99a50a-17ea-4be6-931d-dc8164d3503f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:54.059380 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6a99a50a-17ea-4be6-931d-dc8164d3503f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:54.067051 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6a99a50a-17ea-4be6-931d-dc8164d3503f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:54.067493 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6a99a50a-17ea-4be6-931d-dc8164d3503f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:54.068325 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6a99a50a-17ea-4be6-931d-dc8164d3503f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:54.068757 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6a99a50a-17ea-4be6-931d-dc8164d3503f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:54.198895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6a99a50a-17ea-4be6-931d-dc8164d3503f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:23:54.207440 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6a99a50a-17ea-4be6-931d-dc8164d3503f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1265 microversion: 2.1 time: 0.151469 Jun 16 21:23:54.208005 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 598/1219] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:23:54 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:23:55.224536 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-9b2d0f39-b75c-414f-bb0d-c0035ebdfa19 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:55.225190 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-9b2d0f39-b75c-414f-bb0d-c0035ebdfa19 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:55.231585 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9b2d0f39-b75c-414f-bb0d-c0035ebdfa19 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:55.232033 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9b2d0f39-b75c-414f-bb0d-c0035ebdfa19 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:55.233945 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9b2d0f39-b75c-414f-bb0d-c0035ebdfa19 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:55.234516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-9b2d0f39-b75c-414f-bb0d-c0035ebdfa19 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:55.371054 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-9b2d0f39-b75c-414f-bb0d-c0035ebdfa19 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:23:55.378739 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-9b2d0f39-b75c-414f-bb0d-c0035ebdfa19 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1265 microversion: 2.1 time: 0.158746 Jun 16 21:23:55.379302 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 622/1220] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:23:55 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:23:56.396253 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-75a2fa6a-89c7-41b2-a982-78dba03b33ab tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:56.396897 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-75a2fa6a-89c7-41b2-a982-78dba03b33ab tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:56.399154 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=2 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:23:56.404405 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-75a2fa6a-89c7-41b2-a982-78dba03b33ab tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:56.404845 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-75a2fa6a-89c7-41b2-a982-78dba03b33ab tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:56.405596 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-75a2fa6a-89c7-41b2-a982-78dba03b33ab tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:56.406020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-75a2fa6a-89c7-41b2-a982-78dba03b33ab tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:56.535667 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-75a2fa6a-89c7-41b2-a982-78dba03b33ab tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:23:56.543075 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-75a2fa6a-89c7-41b2-a982-78dba03b33ab tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1265 microversion: 2.1 time: 0.151626 Jun 16 21:23:56.543637 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 599/1221] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:23:56 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:23:57.559823 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-97064663-c120-4b36-a877-0ecc8f6bd9ae tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:57.560468 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-97064663-c120-4b36-a877-0ecc8f6bd9ae tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:57.562454 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:23:57.563107 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=6 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:23:57.570371 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-97064663-c120-4b36-a877-0ecc8f6bd9ae tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:57.570816 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-97064663-c120-4b36-a877-0ecc8f6bd9ae tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:57.571593 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-97064663-c120-4b36-a877-0ecc8f6bd9ae tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:57.572025 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-97064663-c120-4b36-a877-0ecc8f6bd9ae tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:57.733198 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-370e906e-3311-4c2a-b777-3e04ee8c76e0 req-be36fecb-a9f1-4d9d-93fb-8fa8b7c9501d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b395a467-044b-4985-9c95-e86e58ec9012", "name": "network-vif-plugged", "status": "completed", "tag": "0a40dae4-ce88-45f2-8618-3e70841b7d83"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:23:57.743748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-370e906e-3311-4c2a-b777-3e04ee8c76e0 req-be36fecb-a9f1-4d9d-93fb-8fa8b7c9501d service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:57.744215 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-370e906e-3311-4c2a-b777-3e04ee8c76e0 req-be36fecb-a9f1-4d9d-93fb-8fa8b7c9501d service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:57.756814 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-370e906e-3311-4c2a-b777-3e04ee8c76e0 req-be36fecb-a9f1-4d9d-93fb-8fa8b7c9501d service nova] Creating event network-vif-plugged:0a40dae4-ce88-45f2-8618-3e70841b7d83 for instance b395a467-044b-4985-9c95-e86e58ec9012 on hv-cinder-81914 Jun 16 21:23:57.762207 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-370e906e-3311-4c2a-b777-3e04ee8c76e0 req-be36fecb-a9f1-4d9d-93fb-8fa8b7c9501d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032738 Jun 16 21:23:57.762816 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 600/1222] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:23:57.962231 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-97064663-c120-4b36-a877-0ecc8f6bd9ae tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:23:57.969950 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-97064663-c120-4b36-a877-0ecc8f6bd9ae tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1265 microversion: 2.1 time: 0.413969 Jun 16 21:23:57.970516 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 623/1223] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:23:57 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1265 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:23:58.987903 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c3cd7c3b-58fb-4332-b084-770b727edfab tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:23:58.988555 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c3cd7c3b-58fb-4332-b084-770b727edfab tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:23:58.994661 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c3cd7c3b-58fb-4332-b084-770b727edfab tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:58.995101 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c3cd7c3b-58fb-4332-b084-770b727edfab tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:58.995856 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c3cd7c3b-58fb-4332-b084-770b727edfab tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:23:58.996305 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c3cd7c3b-58fb-4332-b084-770b727edfab tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:23:59.135065 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-c3cd7c3b-58fb-4332-b084-770b727edfab tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:23:59.142454 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c3cd7c3b-58fb-4332-b084-770b727edfab tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1265 microversion: 2.1 time: 0.159267 Jun 16 21:23:59.143012 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 601/1224] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:23:58 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:24:00.158670 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-6a9a0f5e-f2c6-497a-a3a6-b9b3a2d07ec8 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:24:00.159283 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-6a9a0f5e-f2c6-497a-a3a6-b9b3a2d07ec8 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:24:00.166046 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6a9a0f5e-f2c6-497a-a3a6-b9b3a2d07ec8 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:24:00.166483 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6a9a0f5e-f2c6-497a-a3a6-b9b3a2d07ec8 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:24:00.167237 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6a9a0f5e-f2c6-497a-a3a6-b9b3a2d07ec8 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:24:00.167659 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6a9a0f5e-f2c6-497a-a3a6-b9b3a2d07ec8 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:24:00.297760 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6a9a0f5e-f2c6-497a-a3a6-b9b3a2d07ec8 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:24:00.305644 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-6a9a0f5e-f2c6-497a-a3a6-b9b3a2d07ec8 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1452 microversion: 2.1 time: 0.150829 Jun 16 21:24:00.306208 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 624/1225] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:24:00 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:24:00.322107 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b65bce78-6e48-4307-9d4a-a514d03468fc tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:24:00.322749 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b65bce78-6e48-4307-9d4a-a514d03468fc tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:24:00.329160 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b65bce78-6e48-4307-9d4a-a514d03468fc tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:24:00.329608 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b65bce78-6e48-4307-9d4a-a514d03468fc tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:24:00.330367 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b65bce78-6e48-4307-9d4a-a514d03468fc tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:24:00.331411 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b65bce78-6e48-4307-9d4a-a514d03468fc tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:24:00.460033 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b65bce78-6e48-4307-9d4a-a514d03468fc tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:24:00.467672 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b65bce78-6e48-4307-9d4a-a514d03468fc tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1452 microversion: 2.1 time: 0.149409 Jun 16 21:24:00.468262 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 602/1226] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:24:00 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:24:02.098221 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [req-a64be150-c476-40f2-aaaf-a053de91ce2a req-a95247c3-8300-4489-a086-174644fef9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b395a467-044b-4985-9c95-e86e58ec9012", "tag": "0a40dae4-ce88-45f2-8618-3e70841b7d83"}]} {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:24:02.106267 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-a64be150-c476-40f2-aaaf-a053de91ce2a req-a95247c3-8300-4489-a086-174644fef9d1 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:24:02.106708 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [req-a64be150-c476-40f2-aaaf-a053de91ce2a req-a95247c3-8300-4489-a086-174644fef9d1 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:24:02.118177 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.compute.server_external_events [req-a64be150-c476-40f2-aaaf-a053de91ce2a req-a95247c3-8300-4489-a086-174644fef9d1 service nova] Creating event network-changed:0a40dae4-ce88-45f2-8618-3e70841b7d83 for instance b395a467-044b-4985-9c95-e86e58ec9012 on hv-cinder-81914 Jun 16 21:24:02.123599 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [req-a64be150-c476-40f2-aaaf-a053de91ce2a req-a95247c3-8300-4489-a086-174644fef9d1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088065 Jun 16 21:24:02.124132 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 625/1227] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:24:59.477667 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 21:24:59.478324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Thu Jun 16 21:24:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 21:25:49.032911 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=26 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:25:49.033646 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=58 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:25:49.038000 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-c64d94d0-f2cd-4f08-8021-aca0e4db9eeb tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1993103551", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-304404175", "security_groups": [{"name": "tempest-secgroup-smoke-148137412"}], "block_device_mapping_v2": [{"uuid": "f953efb3-ae90-4a02-9462-4bf23aea06d3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61c8c5ff-f4fd-4e8b-b3f3-0e031fc4324d"}]}} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:25:49.149380 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.network.neutron [None req-c64d94d0-f2cd-4f08-8021-aca0e4db9eeb tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] validate_networks() for [('61c8c5ff-f4fd-4e8b-b3f3-0e031fc4324d', None, None, None, None, None)] {{(pid=117738) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 21:25:49.845744 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-c64d94d0-f2cd-4f08-8021-aca0e4db9eeb tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Flavor limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 21:25:49.846166 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-c64d94d0-f2cd-4f08-8021-aca0e4db9eeb tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Image limits 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 21:25:49.846641 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-c64d94d0-f2cd-4f08-8021-aca0e4db9eeb tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Flavor pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 21:25:49.847050 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-c64d94d0-f2cd-4f08-8021-aca0e4db9eeb tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Image pref 0:0:0 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 21:25:49.847460 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.virt.hardware [None req-c64d94d0-f2cd-4f08-8021-aca0e4db9eeb tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 21:25:49.856196 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c64d94d0-f2cd-4f08-8021-aca0e4db9eeb tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:49.856651 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c64d94d0-f2cd-4f08-8021-aca0e4db9eeb tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:49.857454 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c64d94d0-f2cd-4f08-8021-aca0e4db9eeb tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:49.857893 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-c64d94d0-f2cd-4f08-8021-aca0e4db9eeb tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:49.874478 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-c64d94d0-f2cd-4f08-8021-aca0e4db9eeb tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Getting quotas for project b568a213302f46fda9ab9467d36996c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 21:25:49.879023 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.quota [None req-c64d94d0-f2cd-4f08-8021-aca0e4db9eeb tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Getting quotas for user 236f49a4117f488ea8bf5c523fadadc8 and project b568a213302f46fda9ab9467d36996c5. Resources: {'instances', 'ram', 'cores'} {{(pid=117738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 21:25:49.934505 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c64d94d0-f2cd-4f08-8021-aca0e4db9eeb tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Going to run 1 instances... {{(pid=117738) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 21:25:49.936647 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-c64d94d0-f2cd-4f08-8021-aca0e4db9eeb tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f953efb3-ae90-4a02-9462-4bf23aea06d3',volume_size=None,volume_type=None)] {{(pid=117738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 21:25:50.060753 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-c64d94d0-f2cd-4f08-8021-aca0e4db9eeb tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.030200 Jun 16 21:25:50.061693 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 603/1228] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 16 21:25:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 21:25:50.070865 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:25:50.071603 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:25:50.079845 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b7684806-6fef-4527-a1ca-ad7e2b1eb46b tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:25:50.080671 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-b7684806-6fef-4527-a1ca-ad7e2b1eb46b tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:25:50.155699 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-b7684806-6fef-4527-a1ca-ad7e2b1eb46b tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:25:50.163342 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b7684806-6fef-4527-a1ca-ad7e2b1eb46b tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1094 microversion: 2.1 time: 0.094976 Jun 16 21:25:50.164105 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 626/1229] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:25:50 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1094 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 21:25:51.180363 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-2e703862-7121-4df1-96bb-c638ac031f68 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:25:51.181193 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-2e703862-7121-4df1-96bb-c638ac031f68 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:25:51.189424 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e703862-7121-4df1-96bb-c638ac031f68 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:51.190164 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e703862-7121-4df1-96bb-c638ac031f68 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:51.191083 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e703862-7121-4df1-96bb-c638ac031f68 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:51.191588 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-2e703862-7121-4df1-96bb-c638ac031f68 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:51.260870 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-2e703862-7121-4df1-96bb-c638ac031f68 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:25:51.269491 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-2e703862-7121-4df1-96bb-c638ac031f68 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1210 microversion: 2.1 time: 0.093133 Jun 16 21:25:51.270056 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 604/1230] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:25:51 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:25:52.286992 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-6ac4c1fc-d399-4d29-813e-e016808d545d tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:25:52.287609 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-6ac4c1fc-d399-4d29-813e-e016808d545d tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:25:52.297514 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6ac4c1fc-d399-4d29-813e-e016808d545d tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:52.297966 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6ac4c1fc-d399-4d29-813e-e016808d545d tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:52.298743 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6ac4c1fc-d399-4d29-813e-e016808d545d tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:52.299182 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-6ac4c1fc-d399-4d29-813e-e016808d545d tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:52.431501 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-db3c0beb-833a-41c9-a167-b3c6dcf4620d req-cdd67213-ceba-452f-b3ac-602c1a81915b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e057c978-981d-4e36-bb14-0f0607d343ef", "tag": "4cfdbe1f-78ce-43c9-80eb-bc4998b0d28b"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:25:52.441974 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-db3c0beb-833a-41c9-a167-b3c6dcf4620d req-cdd67213-ceba-452f-b3ac-602c1a81915b service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:52.442412 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-db3c0beb-833a-41c9-a167-b3c6dcf4620d req-cdd67213-ceba-452f-b3ac-602c1a81915b service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:52.454670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-db3c0beb-833a-41c9-a167-b3c6dcf4620d req-cdd67213-ceba-452f-b3ac-602c1a81915b service nova] Creating event network-changed:4cfdbe1f-78ce-43c9-80eb-bc4998b0d28b for instance e057c978-981d-4e36-bb14-0f0607d343ef on hv-cinder-81914 Jun 16 21:25:52.460462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-db3c0beb-833a-41c9-a167-b3c6dcf4620d req-cdd67213-ceba-452f-b3ac-602c1a81915b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033315 Jun 16 21:25:52.461300 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 605/1231] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:25:52.544140 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-6ac4c1fc-d399-4d29-813e-e016808d545d tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:25:52.553007 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-6ac4c1fc-d399-4d29-813e-e016808d545d tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1265 microversion: 2.1 time: 0.269834 Jun 16 21:25:52.553860 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 627/1232] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:25:52 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:25:53.571345 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-04b7758f-daed-41a3-b2a3-40dd9a855c0a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:25:53.572264 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-04b7758f-daed-41a3-b2a3-40dd9a855c0a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:25:53.578997 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04b7758f-daed-41a3-b2a3-40dd9a855c0a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:53.579333 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04b7758f-daed-41a3-b2a3-40dd9a855c0a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:53.580451 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04b7758f-daed-41a3-b2a3-40dd9a855c0a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:53.580886 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-04b7758f-daed-41a3-b2a3-40dd9a855c0a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:53.716143 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-04b7758f-daed-41a3-b2a3-40dd9a855c0a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:25:53.723744 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-04b7758f-daed-41a3-b2a3-40dd9a855c0a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1265 microversion: 2.1 time: 0.157137 Jun 16 21:25:53.724320 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 606/1233] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:25:53 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:25:54.741105 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-af6c80a4-87cf-4ee9-b848-c92842366cef tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:25:54.741745 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-af6c80a4-87cf-4ee9-b848-c92842366cef tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:25:54.748470 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-af6c80a4-87cf-4ee9-b848-c92842366cef tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:54.748909 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-af6c80a4-87cf-4ee9-b848-c92842366cef tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:54.749695 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-af6c80a4-87cf-4ee9-b848-c92842366cef tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:54.750978 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-af6c80a4-87cf-4ee9-b848-c92842366cef tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:54.887354 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-af6c80a4-87cf-4ee9-b848-c92842366cef tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:25:54.896802 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-af6c80a4-87cf-4ee9-b848-c92842366cef tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1265 microversion: 2.1 time: 0.159512 Jun 16 21:25:54.897381 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 628/1234] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:25:54 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:25:55.913655 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-5744693c-4fc5-4792-8cc8-475e501cc46c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:25:55.914219 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-5744693c-4fc5-4792-8cc8-475e501cc46c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:25:55.920992 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5744693c-4fc5-4792-8cc8-475e501cc46c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:55.921442 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5744693c-4fc5-4792-8cc8-475e501cc46c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:55.922834 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5744693c-4fc5-4792-8cc8-475e501cc46c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:55.923265 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-5744693c-4fc5-4792-8cc8-475e501cc46c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:56.058922 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-5744693c-4fc5-4792-8cc8-475e501cc46c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:25:56.066718 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-5744693c-4fc5-4792-8cc8-475e501cc46c tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1265 microversion: 2.1 time: 0.157037 Jun 16 21:25:56.067270 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 607/1235] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:25:55 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:25:57.083067 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-41041069-1540-438f-8463-011a2d7f44ef tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:25:57.083663 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-41041069-1540-438f-8463-011a2d7f44ef tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:25:57.090152 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-41041069-1540-438f-8463-011a2d7f44ef tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:57.090595 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-41041069-1540-438f-8463-011a2d7f44ef tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:57.091356 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-41041069-1540-438f-8463-011a2d7f44ef tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:57.091786 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-41041069-1540-438f-8463-011a2d7f44ef tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:57.224296 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-41041069-1540-438f-8463-011a2d7f44ef tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:25:57.231685 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-41041069-1540-438f-8463-011a2d7f44ef tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1265 microversion: 2.1 time: 0.152475 Jun 16 21:25:57.232279 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 629/1236] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:25:57 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:25:58.247943 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-71448813-1caf-4320-9f75-14dbc8857658 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:25:58.248611 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-71448813-1caf-4320-9f75-14dbc8857658 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:25:58.255922 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-71448813-1caf-4320-9f75-14dbc8857658 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:58.256407 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-71448813-1caf-4320-9f75-14dbc8857658 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:58.257175 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-71448813-1caf-4320-9f75-14dbc8857658 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:58.257605 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-71448813-1caf-4320-9f75-14dbc8857658 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:58.387337 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-71448813-1caf-4320-9f75-14dbc8857658 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:25:58.395750 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-71448813-1caf-4320-9f75-14dbc8857658 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1265 microversion: 2.1 time: 0.151957 Jun 16 21:25:58.396321 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 608/1237] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:25:58 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:25:59.411489 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-bbc7e9b0-6cf7-4b0b-88c9-695082e14774 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:25:59.412127 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-bbc7e9b0-6cf7-4b0b-88c9-695082e14774 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:25:59.418862 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bbc7e9b0-6cf7-4b0b-88c9-695082e14774 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:59.419303 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bbc7e9b0-6cf7-4b0b-88c9-695082e14774 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:59.420060 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bbc7e9b0-6cf7-4b0b-88c9-695082e14774 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:25:59.420514 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-bbc7e9b0-6cf7-4b0b-88c9-695082e14774 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:25:59.548759 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-bbc7e9b0-6cf7-4b0b-88c9-695082e14774 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:25:59.556277 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-bbc7e9b0-6cf7-4b0b-88c9-695082e14774 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1265 microversion: 2.1 time: 0.148632 Jun 16 21:25:59.556826 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 630/1238] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:25:59 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:26:00.573307 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-4a223f22-d094-4229-bc1a-22fee0c31c54 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:26:00.573956 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-4a223f22-d094-4229-bc1a-22fee0c31c54 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:26:00.576381 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=2 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:26:00.577119 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell0:SELECT=6 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:26:00.583037 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4a223f22-d094-4229-bc1a-22fee0c31c54 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:26:00.583482 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4a223f22-d094-4229-bc1a-22fee0c31c54 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:26:00.584272 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4a223f22-d094-4229-bc1a-22fee0c31c54 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:26:00.584708 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-4a223f22-d094-4229-bc1a-22fee0c31c54 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:26:00.722753 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-4a223f22-d094-4229-bc1a-22fee0c31c54 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:26:00.730189 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-4a223f22-d094-4229-bc1a-22fee0c31c54 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1265 microversion: 2.1 time: 0.160707 Jun 16 21:26:00.730753 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 609/1239] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:26:00 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:26:01.747236 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-12b5c049-15db-414f-89ac-2c174b1cf381 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:26:01.747842 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-12b5c049-15db-414f-89ac-2c174b1cf381 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:26:01.749946 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell0:SELECT=2 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:26:01.756554 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-12b5c049-15db-414f-89ac-2c174b1cf381 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:26:01.756997 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-12b5c049-15db-414f-89ac-2c174b1cf381 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:26:01.757760 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-12b5c049-15db-414f-89ac-2c174b1cf381 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:26:01.758196 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-12b5c049-15db-414f-89ac-2c174b1cf381 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:26:01.893144 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-12b5c049-15db-414f-89ac-2c174b1cf381 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:26:01.900519 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-12b5c049-15db-414f-89ac-2c174b1cf381 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1265 microversion: 2.1 time: 0.157410 Jun 16 21:26:01.901080 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 631/1240] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:26:01 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:26:02.917174 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b248ef8e-2f02-48dd-93b7-dc47265bd882 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:26:02.917796 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b248ef8e-2f02-48dd-93b7-dc47265bd882 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:26:02.924431 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b248ef8e-2f02-48dd-93b7-dc47265bd882 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:26:02.924876 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b248ef8e-2f02-48dd-93b7-dc47265bd882 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:26:02.925658 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b248ef8e-2f02-48dd-93b7-dc47265bd882 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:26:02.926090 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b248ef8e-2f02-48dd-93b7-dc47265bd882 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:26:03.058608 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b248ef8e-2f02-48dd-93b7-dc47265bd882 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:26:03.065895 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b248ef8e-2f02-48dd-93b7-dc47265bd882 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1265 microversion: 2.1 time: 0.152629 Jun 16 21:26:03.066462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 610/1241] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:26:02 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:26:04.082709 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-afb62ee9-a8a3-4c0e-9c11-52ac48b81a1f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:26:04.083472 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-afb62ee9-a8a3-4c0e-9c11-52ac48b81a1f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:26:04.089942 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-afb62ee9-a8a3-4c0e-9c11-52ac48b81a1f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:26:04.090396 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-afb62ee9-a8a3-4c0e-9c11-52ac48b81a1f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:26:04.091160 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-afb62ee9-a8a3-4c0e-9c11-52ac48b81a1f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:26:04.091586 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-afb62ee9-a8a3-4c0e-9c11-52ac48b81a1f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:26:04.226920 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-afb62ee9-a8a3-4c0e-9c11-52ac48b81a1f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:26:04.234405 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-afb62ee9-a8a3-4c0e-9c11-52ac48b81a1f tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1265 microversion: 2.1 time: 0.156082 Jun 16 21:26:04.234966 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 632/1242] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:26:04 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:26:04.393606 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-4657034e-7259-4772-9873-b34ead0ce8fe req-1acd2f63-911d-4aa6-9fa4-c5efb911413c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e057c978-981d-4e36-bb14-0f0607d343ef", "name": "network-vif-plugged", "status": "completed", "tag": "4cfdbe1f-78ce-43c9-80eb-bc4998b0d28b"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:26:04.401659 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-4657034e-7259-4772-9873-b34ead0ce8fe req-1acd2f63-911d-4aa6-9fa4-c5efb911413c service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:26:04.402100 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-4657034e-7259-4772-9873-b34ead0ce8fe req-1acd2f63-911d-4aa6-9fa4-c5efb911413c service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:26:04.413123 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-4657034e-7259-4772-9873-b34ead0ce8fe req-1acd2f63-911d-4aa6-9fa4-c5efb911413c service nova] Creating event network-vif-plugged:4cfdbe1f-78ce-43c9-80eb-bc4998b0d28b for instance e057c978-981d-4e36-bb14-0f0607d343ef on hv-cinder-81914 Jun 16 21:26:04.418062 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-4657034e-7259-4772-9873-b34ead0ce8fe req-1acd2f63-911d-4aa6-9fa4-c5efb911413c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131258 Jun 16 21:26:04.418638 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 611/1243] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:26:05.252385 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-92aeb565-169c-4f92-b48d-90cc8db3a0db tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:26:05.253015 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-92aeb565-169c-4f92-b48d-90cc8db3a0db tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:26:05.259428 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-92aeb565-169c-4f92-b48d-90cc8db3a0db tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:26:05.259869 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-92aeb565-169c-4f92-b48d-90cc8db3a0db tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:26:05.260678 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-92aeb565-169c-4f92-b48d-90cc8db3a0db tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:26:05.261115 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-92aeb565-169c-4f92-b48d-90cc8db3a0db tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:26:05.392095 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-92aeb565-169c-4f92-b48d-90cc8db3a0db tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:26:05.399562 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-92aeb565-169c-4f92-b48d-90cc8db3a0db tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1265 microversion: 2.1 time: 0.151839 Jun 16 21:26:05.400132 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 633/1244] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:26:05 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:26:06.417364 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-6b5f6a2b-2013-4a14-a4b8-c549969642f9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:26:06.418067 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-6b5f6a2b-2013-4a14-a4b8-c549969642f9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:26:06.424906 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6b5f6a2b-2013-4a14-a4b8-c549969642f9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:26:06.425455 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6b5f6a2b-2013-4a14-a4b8-c549969642f9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:26:06.426223 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6b5f6a2b-2013-4a14-a4b8-c549969642f9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:26:06.426662 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-6b5f6a2b-2013-4a14-a4b8-c549969642f9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:26:06.558277 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-6b5f6a2b-2013-4a14-a4b8-c549969642f9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:26:06.566682 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-6b5f6a2b-2013-4a14-a4b8-c549969642f9 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1451 microversion: 2.1 time: 0.154101 Jun 16 21:26:06.567241 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 612/1245] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:26:06 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:26:06.584131 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-86d69278-5bbc-4e29-88ab-5d2f6123a4ca tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:26:06.584761 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-86d69278-5bbc-4e29-88ab-5d2f6123a4ca tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:26:06.591041 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-86d69278-5bbc-4e29-88ab-5d2f6123a4ca tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:26:06.591490 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-86d69278-5bbc-4e29-88ab-5d2f6123a4ca tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:26:06.592554 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-86d69278-5bbc-4e29-88ab-5d2f6123a4ca tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:26:06.592982 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-86d69278-5bbc-4e29-88ab-5d2f6123a4ca tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:26:06.723271 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-86d69278-5bbc-4e29-88ab-5d2f6123a4ca tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:26:06.730661 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-86d69278-5bbc-4e29-88ab-5d2f6123a4ca tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1451 microversion: 2.1 time: 0.151594 Jun 16 21:26:06.731216 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 634/1246] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:26:06 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:26:08.537839 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-6a5859b6-8fe3-4e2c-a38e-7143ce2097be req-6843f07e-ebc0-449f-9966-0a567e2699bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e057c978-981d-4e36-bb14-0f0607d343ef", "tag": "4cfdbe1f-78ce-43c9-80eb-bc4998b0d28b"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:26:08.546078 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-6a5859b6-8fe3-4e2c-a38e-7143ce2097be req-6843f07e-ebc0-449f-9966-0a567e2699bb service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:26:08.546594 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-6a5859b6-8fe3-4e2c-a38e-7143ce2097be req-6843f07e-ebc0-449f-9966-0a567e2699bb service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:26:08.557795 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-6a5859b6-8fe3-4e2c-a38e-7143ce2097be req-6843f07e-ebc0-449f-9966-0a567e2699bb service nova] Creating event network-changed:4cfdbe1f-78ce-43c9-80eb-bc4998b0d28b for instance e057c978-981d-4e36-bb14-0f0607d343ef on hv-cinder-81914 Jun 16 21:26:08.562740 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-6a5859b6-8fe3-4e2c-a38e-7143ce2097be req-6843f07e-ebc0-449f-9966-0a567e2699bb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029174 Jun 16 21:26:08.563324 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 613/1247] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:26:29.729550 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 21:26:29.730171 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Thu Jun 16 21:26:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 21:26:32.734380 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 21:26:32.734962 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Thu Jun 16 21:26:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 21:26:42.953283 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 21:26:42.953944 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Thu Jun 16 21:26:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 21:26:54.177405 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 21:26:54.178138 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Thu Jun 16 21:26:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 21:27:38.234951 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:27:38.236296 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG dbcounter [-] [117738] Writing DB stats nova_cell1:SELECT=50 {{(pid=117738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:27:38.236495 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-40db8110-e303-416f-b559-5c7d9bfd151a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:27:38.237810 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-40db8110-e303-416f-b559-5c7d9bfd151a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:27:38.240005 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_api:SELECT=20 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:27:38.240748 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG dbcounter [-] [117737] Writing DB stats nova_cell1:SELECT=48 {{(pid=117737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:27:38.241084 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-1019df46-1d57-4251-bc74-cecac7c9e098 req-862ce7d3-3202-4cb5-86cc-befcc7a4f30d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e057c978-981d-4e36-bb14-0f0607d343ef", "tag": "4cfdbe1f-78ce-43c9-80eb-bc4998b0d28b"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:27:38.246959 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-40db8110-e303-416f-b559-5c7d9bfd151a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:38.247805 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-40db8110-e303-416f-b559-5c7d9bfd151a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:38.248622 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-40db8110-e303-416f-b559-5c7d9bfd151a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:38.249062 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-40db8110-e303-416f-b559-5c7d9bfd151a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:38.252915 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-1019df46-1d57-4251-bc74-cecac7c9e098 req-862ce7d3-3202-4cb5-86cc-befcc7a4f30d service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:38.253686 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-1019df46-1d57-4251-bc74-cecac7c9e098 req-862ce7d3-3202-4cb5-86cc-befcc7a4f30d service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:38.264863 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-1019df46-1d57-4251-bc74-cecac7c9e098 req-862ce7d3-3202-4cb5-86cc-befcc7a4f30d service nova] Creating event network-changed:4cfdbe1f-78ce-43c9-80eb-bc4998b0d28b for instance e057c978-981d-4e36-bb14-0f0607d343ef on hv-cinder-81914 Jun 16 21:27:38.270687 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-1019df46-1d57-4251-bc74-cecac7c9e098 req-862ce7d3-3202-4cb5-86cc-befcc7a4f30d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037653 Jun 16 21:27:38.271462 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 614/1248] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 21:27:38.277041 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-40db8110-e303-416f-b559-5c7d9bfd151a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Going to try to terminate instance {{(pid=117737) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:27:38.362368 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-40db8110-e303-416f-b559-5c7d9bfd151a tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 204 len: 0 microversion: 2.1 time: 0.130454 Jun 16 21:27:38.362951 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 635/1249] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:27:38 2022] DELETE /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:27:38.372337 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-a0460b7f-8575-4df0-bc2f-f914fc5737f4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:27:38.373346 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-a0460b7f-8575-4df0-bc2f-f914fc5737f4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:27:38.381028 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a0460b7f-8575-4df0-bc2f-f914fc5737f4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:38.381742 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a0460b7f-8575-4df0-bc2f-f914fc5737f4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:38.382676 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a0460b7f-8575-4df0-bc2f-f914fc5737f4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:38.383269 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-a0460b7f-8575-4df0-bc2f-f914fc5737f4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:38.520535 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-a0460b7f-8575-4df0-bc2f-f914fc5737f4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:27:38.527980 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-a0460b7f-8575-4df0-bc2f-f914fc5737f4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1575 microversion: 2.1 time: 0.160285 Jun 16 21:27:38.528573 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 615/1250] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:27:38 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:27:39.546203 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-cdfec764-5234-483b-b8db-b12841c00110 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:27:39.546901 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-cdfec764-5234-483b-b8db-b12841c00110 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:27:39.554594 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cdfec764-5234-483b-b8db-b12841c00110 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:39.555036 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cdfec764-5234-483b-b8db-b12841c00110 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:39.555793 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cdfec764-5234-483b-b8db-b12841c00110 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:39.556243 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-cdfec764-5234-483b-b8db-b12841c00110 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:39.762548 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-cdfec764-5234-483b-b8db-b12841c00110 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:27:39.770469 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-cdfec764-5234-483b-b8db-b12841c00110 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1575 microversion: 2.1 time: 0.228472 Jun 16 21:27:39.771017 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 636/1251] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:27:39 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1575 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:27:40.653583 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-d084f557-114f-4a56-a21d-2817ba35dbbc req-21d5e757-b8e4-4e77-8761-2b3d5a57b249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e057c978-981d-4e36-bb14-0f0607d343ef", "name": "network-vif-deleted", "tag": "4cfdbe1f-78ce-43c9-80eb-bc4998b0d28b"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:27:40.664538 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-d084f557-114f-4a56-a21d-2817ba35dbbc req-21d5e757-b8e4-4e77-8761-2b3d5a57b249 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:40.664888 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-d084f557-114f-4a56-a21d-2817ba35dbbc req-21d5e757-b8e4-4e77-8761-2b3d5a57b249 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:40.677057 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-d084f557-114f-4a56-a21d-2817ba35dbbc req-21d5e757-b8e4-4e77-8761-2b3d5a57b249 service nova] Creating event network-vif-deleted:4cfdbe1f-78ce-43c9-80eb-bc4998b0d28b for instance e057c978-981d-4e36-bb14-0f0607d343ef on hv-cinder-81914 Jun 16 21:27:40.682090 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-d084f557-114f-4a56-a21d-2817ba35dbbc req-21d5e757-b8e4-4e77-8761-2b3d5a57b249 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032230 Jun 16 21:27:40.682686 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 616/1252] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:27:40.787760 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-31fef715-b620-4ba7-930f-ea04d009c2a1 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:27:40.788449 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-31fef715-b620-4ba7-930f-ea04d009c2a1 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:27:40.794850 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-31fef715-b620-4ba7-930f-ea04d009c2a1 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:40.795297 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-31fef715-b620-4ba7-930f-ea04d009c2a1 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:40.796065 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-31fef715-b620-4ba7-930f-ea04d009c2a1 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:40.796534 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-31fef715-b620-4ba7-930f-ea04d009c2a1 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:40.860147 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-31fef715-b620-4ba7-930f-ea04d009c2a1 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:27:40.868346 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-31fef715-b620-4ba7-930f-ea04d009c2a1 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 200 len: 1225 microversion: 2.1 time: 0.084984 Jun 16 21:27:40.868903 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 637/1253] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:27:40 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:27:41.886114 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d701f16a-31c6-44af-9b8c-b1db02edf318 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:27:41.886737 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-d701f16a-31c6-44af-9b8c-b1db02edf318 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: e057c978-981d-4e36-bb14-0f0607d343ef] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:27:41.892873 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d701f16a-31c6-44af-9b8c-b1db02edf318 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:41.893591 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d701f16a-31c6-44af-9b8c-b1db02edf318 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:41.894130 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d701f16a-31c6-44af-9b8c-b1db02edf318 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:41.894555 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-d701f16a-31c6-44af-9b8c-b1db02edf318 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:41.907234 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-d701f16a-31c6-44af-9b8c-b1db02edf318 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] HTTP exception thrown: Instance e057c978-981d-4e36-bb14-0f0607d343ef could not be found. Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d701f16a-31c6-44af-9b8c-b1db02edf318 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Request method failure captured: Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef HTTP/1.1 Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq56Llv3ryZkyCbRk0t5zG4G9MvYA1WMRX0dufjj8QeDkpg8uTgcid7rjKZB8rZYvw6mv5z9RmztTzmv9RoRYR6lnDyY3kIHKk8HijLMgYQaDfAyFCpDb0T4dKHNHJVOeKFdH2LcYOYiNyhfk8HsrjXciaSx2jYyyyYDcVBxYIgBa6ZU Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: b568a213302f46fda9ab9467d36996c5 Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-TestVolumeBootPattern-691594804 Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:27:41.908919 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:27:41.911021 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b568a213302f46fda9ab9467d36996c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b568a213302f46fda9ab9467d36996c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b568a213302f46fda9ab9467d36996c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b568a213302f46fda9ab9467d36996c5"}]}] Jun 16 21:27:41.911021 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-TestVolumeBootPattern-691594804 Jun 16 21:27:41.911021 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: b568a213302f46fda9ab9467d36996c5 Jun 16 21:27:41.911021 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-TestVolumeBootPattern-691594804 Jun 16 21:27:41.911021 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-TestVolumeBootPattern-691594804-project Jun 16 21:27:41.911021 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:27:41.911021 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:27:41.911021 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 236f49a4117f488ea8bf5c523fadadc8 Jun 16 21:27:41.911021 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-TestVolumeBootPattern-691594804-project Jun 16 21:27:41.911021 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:27:41.911021 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance e057c978-981d-4e36-bb14-0f0607d343ef could not be found. Jun 16 21:27:41.911021 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': 'e057c978-981d-4e36-bb14-0f0607d343ef'} Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e057c978-981d-4e36-bb14-0f0607d343ef could not be found. Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:27:41.911988 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e057c978-981d-4e36-bb14-0f0607d343ef could not be found. Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e057c978-981d-4e36-bb14-0f0607d343ef could not be found. Jun 16 21:27:41.913821 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:27:41.915352 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-d701f16a-31c6-44af-9b8c-b1db02edf318 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Returning 404 to user: Instance e057c978-981d-4e36-bb14-0f0607d343ef could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:27:41.915352 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-d701f16a-31c6-44af-9b8c-b1db02edf318 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef" status: 404 len: 111 microversion: 2.1 time: 0.028899 Jun 16 21:27:41.915352 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 617/1254] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:27:41 2022] GET /compute/v2.1/servers/e057c978-981d-4e36-bb14-0f0607d343ef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:27:44.962983 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-75a5039a-8c99-43ea-8345-64a6d9f78d22 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:27:44.963575 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-75a5039a-8c99-43ea-8345-64a6d9f78d22 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:27:44.965670 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-9a926eab-fe72-481e-bf78-4b7f552fa428 req-6580e813-e9f3-43ec-88fb-3b016919fe22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b395a467-044b-4985-9c95-e86e58ec9012", "tag": "0a40dae4-ce88-45f2-8618-3e70841b7d83"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:27:44.970529 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-75a5039a-8c99-43ea-8345-64a6d9f78d22 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:44.971922 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-75a5039a-8c99-43ea-8345-64a6d9f78d22 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:44.972957 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-75a5039a-8c99-43ea-8345-64a6d9f78d22 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:44.973555 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-75a5039a-8c99-43ea-8345-64a6d9f78d22 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:44.975144 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-9a926eab-fe72-481e-bf78-4b7f552fa428 req-6580e813-e9f3-43ec-88fb-3b016919fe22 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:44.975844 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-9a926eab-fe72-481e-bf78-4b7f552fa428 req-6580e813-e9f3-43ec-88fb-3b016919fe22 service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:44.989219 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-9a926eab-fe72-481e-bf78-4b7f552fa428 req-6580e813-e9f3-43ec-88fb-3b016919fe22 service nova] Creating event network-changed:0a40dae4-ce88-45f2-8618-3e70841b7d83 for instance b395a467-044b-4985-9c95-e86e58ec9012 on hv-cinder-81914 Jun 16 21:27:44.994748 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-9a926eab-fe72-481e-bf78-4b7f552fa428 req-6580e813-e9f3-43ec-88fb-3b016919fe22 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033039 Jun 16 21:27:44.996130 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 618/1255] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:27:45.000919 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-75a5039a-8c99-43ea-8345-64a6d9f78d22 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Going to try to terminate instance {{(pid=117737) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 21:27:45.093064 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-75a5039a-8c99-43ea-8345-64a6d9f78d22 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 204 len: 0 microversion: 2.1 time: 0.133840 Jun 16 21:27:45.094000 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 638/1256] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:27:44 2022] DELETE /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 21:27:45.102883 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-b9420158-e190-4790-86de-9c9cd9a549df tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:27:45.103564 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-b9420158-e190-4790-86de-9c9cd9a549df tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:27:45.110450 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b9420158-e190-4790-86de-9c9cd9a549df tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:45.110891 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b9420158-e190-4790-86de-9c9cd9a549df tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:45.111655 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b9420158-e190-4790-86de-9c9cd9a549df tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:45.112803 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-b9420158-e190-4790-86de-9c9cd9a549df tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:45.255839 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.policy [None req-b9420158-e190-4790-86de-9c9cd9a549df tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117738) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:27:45.263504 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-b9420158-e190-4790-86de-9c9cd9a549df tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1577 microversion: 2.1 time: 0.164740 Jun 16 21:27:45.264062 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 619/1257] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:27:45 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:27:46.282081 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-c8e26246-f43c-4e51-a707-2c6096a276ee tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:27:46.282691 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-c8e26246-f43c-4e51-a707-2c6096a276ee tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:27:46.289852 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c8e26246-f43c-4e51-a707-2c6096a276ee tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:46.290290 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c8e26246-f43c-4e51-a707-2c6096a276ee tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:46.291040 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c8e26246-f43c-4e51-a707-2c6096a276ee tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:46.291500 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-c8e26246-f43c-4e51-a707-2c6096a276ee tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:46.496512 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-c8e26246-f43c-4e51-a707-2c6096a276ee tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:27:46.503965 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-c8e26246-f43c-4e51-a707-2c6096a276ee tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1577 microversion: 2.1 time: 0.226223 Jun 16 21:27:46.504546 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 639/1258] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:27:46 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1577 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:27:47.431677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [req-c98d9d03-3597-41e0-8e65-6c8b911649ad req-8be51a8d-330a-44fe-b770-0f3b9a44a5ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b395a467-044b-4985-9c95-e86e58ec9012", "name": "network-vif-deleted", "tag": "0a40dae4-ce88-45f2-8618-3e70841b7d83"}]} {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 21:27:47.440110 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-c98d9d03-3597-41e0-8e65-6c8b911649ad req-8be51a8d-330a-44fe-b770-0f3b9a44a5ee service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:47.440603 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [req-c98d9d03-3597-41e0-8e65-6c8b911649ad req-8be51a8d-330a-44fe-b770-0f3b9a44a5ee service nova] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:47.451627 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.compute.server_external_events [req-c98d9d03-3597-41e0-8e65-6c8b911649ad req-8be51a8d-330a-44fe-b770-0f3b9a44a5ee service nova] Creating event network-vif-deleted:0a40dae4-ce88-45f2-8618-3e70841b7d83 for instance b395a467-044b-4985-9c95-e86e58ec9012 on hv-cinder-81914 Jun 16 21:27:47.457231 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [req-c98d9d03-3597-41e0-8e65-6c8b911649ad req-8be51a8d-330a-44fe-b770-0f3b9a44a5ee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028826 Jun 16 21:27:47.458020 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 620/1259] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 16 21:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 21:27:47.521464 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-33d51959-0613-42d6-b255-894945bc2f77 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:27:47.522101 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-33d51959-0613-42d6-b255-894945bc2f77 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:27:47.528612 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-33d51959-0613-42d6-b255-894945bc2f77 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:47.529050 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-33d51959-0613-42d6-b255-894945bc2f77 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:47.529796 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-33d51959-0613-42d6-b255-894945bc2f77 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:47.530273 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-33d51959-0613-42d6-b255-894945bc2f77 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:47.590936 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.policy [None req-33d51959-0613-42d6-b255-894945bc2f77 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236f49a4117f488ea8bf5c523fadadc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b568a213302f46fda9ab9467d36996c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117737) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 21:27:47.599509 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-33d51959-0613-42d6-b255-894945bc2f77 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 200 len: 1225 microversion: 2.1 time: 0.082616 Jun 16 21:27:47.600086 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 640/1260] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:27:47 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 21:27:48.617892 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-be5912b9-d008-49fd-8292-f91e491b1f86 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:27:48.618621 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-be5912b9-d008-49fd-8292-f91e491b1f86 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: b395a467-044b-4985-9c95-e86e58ec9012] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:27:48.625077 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-be5912b9-d008-49fd-8292-f91e491b1f86 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:48.625525 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-be5912b9-d008-49fd-8292-f91e491b1f86 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:48.626279 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-be5912b9-d008-49fd-8292-f91e491b1f86 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:48.626710 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-be5912b9-d008-49fd-8292-f91e491b1f86 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:48.639828 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-be5912b9-d008-49fd-8292-f91e491b1f86 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] HTTP exception thrown: Instance b395a467-044b-4985-9c95-e86e58ec9012 could not be found. Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-be5912b9-d008-49fd-8292-f91e491b1f86 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Request method failure captured: Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 HTTP/1.1 Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq56Llv3ryZkyCbRk0t5zG4G9MvYA1WMRX0dufjj8QeDkpg8uTgcid7rjKZB8rZYvw6mv5z9RmztTzmv9RoRYR6lnDyY3kIHKk8HijLMgYQaDfAyFCpDb0T4dKHNHJVOeKFdH2LcYOYiNyhfk8HsrjXciaSx2jYyyyYDcVBxYIgBa6ZU Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: b568a213302f46fda9ab9467d36996c5 Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-TestVolumeBootPattern-691594804 Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:27:48.641439 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:27:48.643657 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b568a213302f46fda9ab9467d36996c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b568a213302f46fda9ab9467d36996c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b568a213302f46fda9ab9467d36996c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b568a213302f46fda9ab9467d36996c5"}]}] Jun 16 21:27:48.643657 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-TestVolumeBootPattern-691594804 Jun 16 21:27:48.643657 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: b568a213302f46fda9ab9467d36996c5 Jun 16 21:27:48.643657 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-TestVolumeBootPattern-691594804 Jun 16 21:27:48.643657 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-TestVolumeBootPattern-691594804-project Jun 16 21:27:48.643657 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:27:48.643657 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:27:48.643657 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 236f49a4117f488ea8bf5c523fadadc8 Jun 16 21:27:48.643657 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-TestVolumeBootPattern-691594804-project Jun 16 21:27:48.643657 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:27:48.643657 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance b395a467-044b-4985-9c95-e86e58ec9012 could not be found. Jun 16 21:27:48.643657 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': 'b395a467-044b-4985-9c95-e86e58ec9012'} Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b395a467-044b-4985-9c95-e86e58ec9012 could not be found. Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:27:48.644677 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b395a467-044b-4985-9c95-e86e58ec9012 could not be found. Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b395a467-044b-4985-9c95-e86e58ec9012 could not be found. Jun 16 21:27:48.646289 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:27:48.647830 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-be5912b9-d008-49fd-8292-f91e491b1f86 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Returning 404 to user: Instance b395a467-044b-4985-9c95-e86e58ec9012 could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:27:48.647830 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-be5912b9-d008-49fd-8292-f91e491b1f86 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012" status: 404 len: 111 microversion: 2.1 time: 0.029769 Jun 16 21:27:48.647830 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 621/1261] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:27:48 2022] GET /compute/v2.1/servers/b395a467-044b-4985-9c95-e86e58ec9012 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:27:49.077979 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-51cc04d0-8f34-443a-9b9e-c402718bc390 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:27:49.078481 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.compute.api [None req-51cc04d0-8f34-443a-9b9e-c402718bc390 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117737) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:27:49.085904 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-51cc04d0-8f34-443a-9b9e-c402718bc390 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:49.086346 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-51cc04d0-8f34-443a-9b9e-c402718bc390 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:49.087103 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-51cc04d0-8f34-443a-9b9e-c402718bc390 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:49.087550 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG oslo_concurrency.lockutils [None req-51cc04d0-8f34-443a-9b9e-c402718bc390 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:49.100737 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.wsgi [None req-51cc04d0-8f34-443a-9b9e-c402718bc390 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] HTTP exception thrown: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-51cc04d0-8f34-443a-9b9e-c402718bc390 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Request method failure captured: Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: request: DELETE /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c HTTP/1.1 Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept: application/json Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Accept-Encoding: identity Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Connection: close Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Length: 0 Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Content-Type: application/json Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Host: 10.222.0.43 Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Openstack-System-Scope: None Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: User-Agent: python-urllib3/1.26.9 Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Auth-Token: gAAAAABiq56Llv3ryZkyCbRk0t5zG4G9MvYA1WMRX0dufjj8QeDkpg8uTgcid7rjKZB8rZYvw6mv5z9RmztTzmv9RoRYR6lnDyY3kIHKk8HijLMgYQaDfAyFCpDb0T4dKHNHJVOeKFdH2LcYOYiNyhfk8HsrjXciaSx2jYyyyYDcVBxYIgBa6ZU Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Id: None Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Domain-Name: None Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Identity-Status: Confirmed Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Is-Admin-Project: True Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Id: default Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Domain-Name: Default Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Id: b568a213302f46fda9ab9467d36996c5 Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Project-Name: tempest-TestVolumeBootPattern-691594804 Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Role: reader,member Jun 16 21:27:49.102362 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Roles: reader,member Jun 16 21:27:49.103939 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b568a213302f46fda9ab9467d36996c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b568a213302f46fda9ab9467d36996c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b568a213302f46fda9ab9467d36996c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b568a213302f46fda9ab9467d36996c5"}]}] Jun 16 21:27:49.103939 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant: tempest-TestVolumeBootPattern-691594804 Jun 16 21:27:49.103939 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Id: b568a213302f46fda9ab9467d36996c5 Jun 16 21:27:49.103939 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-Tenant-Name: tempest-TestVolumeBootPattern-691594804 Jun 16 21:27:49.103939 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User: tempest-TestVolumeBootPattern-691594804-project Jun 16 21:27:49.103939 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Id: default Jun 16 21:27:49.103939 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Domain-Name: Default Jun 16 21:27:49.103939 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Id: 236f49a4117f488ea8bf5c523fadadc8 Jun 16 21:27:49.103939 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: X-User-Name: tempest-TestVolumeBootPattern-691594804-project Jun 16 21:27:49.103939 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: method: > Jun 16 21:27:49.103939 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: exception: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. Jun 16 21:27:49.103939 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: action_args: {'id': '334a1b5b-c324-4952-9875-f93b251a544c'} Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:27:49.104840 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. Jun 16 21:27:49.106206 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: ERROR nova.api.openstack.wsgi Jun 16 21:27:49.107869 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-51cc04d0-8f34-443a-9b9e-c402718bc390 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Returning 404 to user: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. {{(pid=117737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:27:49.107869 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-51cc04d0-8f34-443a-9b9e-c402718bc390 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "DELETE /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 404 len: 111 microversion: 2.1 time: 0.029703 Jun 16 21:27:49.107869 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 641/1262] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 16 21:27:49 2022] DELETE /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:27:49.112438 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-bec2d3b2-f8f0-4c82-b16e-d2ea32165342 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '>' {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:27:49.113054 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.compute.api [None req-bec2d3b2-f8f0-4c82-b16e-d2ea32165342 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] [instance: 334a1b5b-c324-4952-9875-f93b251a544c] Fetching instance by UUID {{(pid=117738) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 21:27:49.118990 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bec2d3b2-f8f0-4c82-b16e-d2ea32165342 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:49.119437 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bec2d3b2-f8f0-4c82-b16e-d2ea32165342 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:49.120537 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bec2d3b2-f8f0-4c82-b16e-d2ea32165342 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 21:27:49.120986 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG oslo_concurrency.lockutils [None req-bec2d3b2-f8f0-4c82-b16e-d2ea32165342 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Lock "29bf6cc7-f6d0-45cb-a745-0a1e3d896f66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 21:27:49.134480 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.wsgi [None req-bec2d3b2-f8f0-4c82-b16e-d2ea32165342 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] HTTP exception thrown: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-bec2d3b2-f8f0-4c82-b16e-d2ea32165342 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Request method failure captured: Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: request: GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c HTTP/1.1 Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept: application/json Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Accept-Encoding: identity Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Connection: close Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Length: 0 Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Content-Type: application/json Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Host: 10.222.0.43 Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Openstack-System-Scope: None Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: User-Agent: python-urllib3/1.26.9 Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Auth-Token: gAAAAABiq56Llv3ryZkyCbRk0t5zG4G9MvYA1WMRX0dufjj8QeDkpg8uTgcid7rjKZB8rZYvw6mv5z9RmztTzmv9RoRYR6lnDyY3kIHKk8HijLMgYQaDfAyFCpDb0T4dKHNHJVOeKFdH2LcYOYiNyhfk8HsrjXciaSx2jYyyyYDcVBxYIgBa6ZU Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Id: None Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Domain-Name: None Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Identity-Status: Confirmed Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Is-Admin-Project: True Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Id: default Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Domain-Name: Default Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Id: b568a213302f46fda9ab9467d36996c5 Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Project-Name: tempest-TestVolumeBootPattern-691594804 Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Role: reader,member Jun 16 21:27:49.135998 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Roles: reader,member Jun 16 21:27:49.137743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b568a213302f46fda9ab9467d36996c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b568a213302f46fda9ab9467d36996c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b568a213302f46fda9ab9467d36996c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b568a213302f46fda9ab9467d36996c5"}]}] Jun 16 21:27:49.137743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant: tempest-TestVolumeBootPattern-691594804 Jun 16 21:27:49.137743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Id: b568a213302f46fda9ab9467d36996c5 Jun 16 21:27:49.137743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-Tenant-Name: tempest-TestVolumeBootPattern-691594804 Jun 16 21:27:49.137743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User: tempest-TestVolumeBootPattern-691594804-project Jun 16 21:27:49.137743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Id: default Jun 16 21:27:49.137743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Domain-Name: Default Jun 16 21:27:49.137743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Id: 236f49a4117f488ea8bf5c523fadadc8 Jun 16 21:27:49.137743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: X-User-Name: tempest-TestVolumeBootPattern-691594804-project Jun 16 21:27:49.137743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: method: > Jun 16 21:27:49.137743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: exception: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. Jun 16 21:27:49.137743 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: action_args: {'id': '334a1b5b-c324-4952-9875-f93b251a544c'} Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: {{(pid=117738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 21:27:49.138684 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. Jun 16 21:27:49.140332 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: ERROR nova.api.openstack.wsgi Jun 16 21:27:49.141671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: DEBUG nova.api.openstack.wsgi [None req-bec2d3b2-f8f0-4c82-b16e-d2ea32165342 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Returning 404 to user: Instance 334a1b5b-c324-4952-9875-f93b251a544c could not be found. {{(pid=117738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 21:27:49.141671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO nova.api.openstack.requestlog [None req-bec2d3b2-f8f0-4c82-b16e-d2ea32165342 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c" status: 404 len: 111 microversion: 2.1 time: 0.028962 Jun 16 21:27:49.141671 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: [pid: 117738|app: 0|req: 622/1263] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 16 21:27:49 2022] GET /compute/v2.1/servers/334a1b5b-c324-4952-9875-f93b251a544c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 21:27:50.426770 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: DEBUG nova.api.openstack.wsgi [None req-b4fbe42e-cc0c-4796-ac3f-b83d4bb7c7d4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] Calling method '.version_select at 0x7fb3f7594550>' {{(pid=117737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 21:27:50.456205 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO nova.api.openstack.requestlog [None req-b4fbe42e-cc0c-4796-ac3f-b83d4bb7c7d4 tempest-TestVolumeBootPattern-691594804 tempest-TestVolumeBootPattern-691594804-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-304404175" status: 202 len: 0 microversion: 2.1 time: 0.033929 Jun 16 21:27:50.457501 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: [pid: 117737|app: 0|req: 642/1264] 10.222.0.43 () {58 vars in 1259 bytes} [Thu Jun 16 21:27:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-304404175 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 21:28:19.485968 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 21:28:19.486556 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Thu Jun 16 21:28:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 21:29:49.737611 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 21:29:49.738195 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Thu Jun 16 21:29:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 21:30:02.962058 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 21:30:02.962611 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Thu Jun 16 21:30:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 21:30:14.186013 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 21:30:14.186628 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Thu Jun 16 21:30:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 21:31:39.494510 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 21:31:39.495142 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Thu Jun 16 21:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 21:33:09.745208 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 21:33:09.746046 dv-cinder-819149-6-iscsi devstack@n-api.service[117738]: Thu Jun 16 21:33:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 21:33:12.746909 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 21:33:12.747348 dv-cinder-819149-6-iscsi devstack@n-api.service[117737]: Thu Jun 16 21:33:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!